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Preface 


This book is based on the experience and the lecture notes of the authors while teaching 
Numerical Analysis for almost four decades at the Indian Institute of Technology, New Delhi. 

This comprehensive textbook covers material for one semester course on Numerical 
Methods of Anna University. The emphasis in the book is on the presentation of fundamentals 
and theoretical concepts in an intelligible and easy to understand manner. The book is written 
as a textbook rather than as a problem/guide book. The textbook offers a logical presentation 
of both the theory and techniques for problem solving to motivate the students for the study 
and application otNumerical Methods. Examples and Problems in Exercises are used to explain 
each theoretical concept and application of these concepts in problem solving. Answers for 
every problem and hints for difficult problems are provided to encourage the students for self¬ 
learning. 

The authors are highly grateful to Prof. M.K. Jain, who was their teacher, colleague 
and co-author of their earlier books on Numerical Analysis. With his approval, we have freely 
used the material from our book, Numerical Methods for Scientific and Engineering 
Computation, published by the same publishers. 

This book is the outcome of the request of Mr. Saumya Gupta, Managing Director, 
New Age International Publishers, for writing a good book on Numerical Methods for Anna 
University. The authors are thankful to him for following it up until the book is complete. 

The first author is thankful to Dr. Gokaraju Gangaraju, President of the college, 
Prof. P.S. Raju, Director and Prof. Jandhyala N. Murthy, Principal, Gokaraju Rangaraju 
Institute of Engineering and Technology, Hyderabad for their encouragement during the 
preparation of the manuscript. 

The second author is thankful to the entire management of Manav Rachna Educational 
Institutions, Faridabad and the Director-Principal of Manav Rachna College of Engineering, 
Faridabad for providing a congenial environment during the writing of this book. 
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Solution of Equations and 
Eigen Value Problems 


1.1 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS 

1.1.1 Introduction 

A problem of great importance in science and engineering is that of determining the roots/ 
zeros of an equation of the form 

fix) = 0, (1.1) 

A polynomial equation of the form 

fix) = P n ix) = OqX" + OjX" -1 + a^" -2 + ... + a nl x + a n = 0 (1.2) 

is called an algebraic equation. An equation which contains polynomials, exponential functions, 
logarithmic functions, trigonometric functions etc. is called a transcendental equation. 

For example, 

3x 3 - 2x 2 - x - 5 = 0, x 4 — 3x 2 + 1 = 0, x 2 - 3x + 1 = 0, 
are algebraic (polynomial) equations, and 

xe 2x -l = 0, cosx-xe* = 0, tanx = x 

are transcendental equations. 

We assume that the function fix) is continuous in the required 
interval. 

We define the following. 

Root/zero A number a, for which fid) = 0 is called a root of the 
equation fix) = 0, or a zero of fix). Geometrically, a root of an equa¬ 
tion/lx) = 0 is the value ofx at which the graph of the equation y = 
fix) intersects the x-axis (see Fig. 1.1). 


f(x)t 



Fig. 1.1 ‘Root of f{x) = 0’ 


1 
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Simple root A number a is a simple root of fix) = 0, if /la) = 0 and f'i a) * 0. Then, we can 
write fix) as 

fix) = ix-a) g(x), gia) * 0. (1.3) 

For example, since ix - 1) is a factor of fix) = x 3 + x - 2 = 0, we can write 
fix) = ix- l)(x 2 + x + 2) = ix - 1) gix), gil) * 0. 

Alternately, we find /(l) = 0, f'ix) = 3x 2 + 1, f'i 1) = 4*0. Hence, x = 1 is a simple root of 
f{x) = x 3 + x- 2 = 0. 

Multiple root A number a is a multiple root, of multiplicity m, of fix) = 0, if 

/(a) = 0, f'ia) = 0, ..., /‘ (m - 1) (a) = 0, and f (m) (a) * 0. (1.4) 

Then, we can write fix) as 

fix) = ix- a) m gix), gia) * 0. 

For example, consider the equation fix) = x 3 - 3x 2 + 4 = 0. We find 

fi2) = 8 - 12 + 4 = 0, f'ix) = 3x 2 - 6x, f'i 2) = 12 - 12 = 0, 
f"ix) = 6x - 6, f"i 2) = 6*0. 

Hence, x = 2 is a multiple root of multiplicity 2 (double root) of fix) = x 3 - 3x 2 + 4 = 0. 
We can write fix) = ix - 2) 2 ix + 1) = ix - 2 ) 2 gix), gi2) = 3*0. 

In this chapter, we shall be considering the case of simple roots only. 

Remark 1 A polynomial equation of degree n has exactly n roots, real or complex, simple or 
multiple, where as a transcendental equation may have one root, infinite number of roots or 
no root. 

We shall derive methods for finding only the real roots. 

The methods for finding the roots are classified as ii) direct methods, and Hi) iterative 
methods. 

Direct methods These methods give the exact values of all the roots in a finite number of 
steps (disregarding the round-off errors). Therefore, for any direct method, we can give the 
total number of operations (additions, subtractions, divisions and multiplications). This number 
is called the operational count of the method. 

For example, the roots of the quadratic equation ax 2 + bx + c = 0, a * 0, can be obtained 
using the method 

For this method, we can give the count of the total number of operations. 

There are direct methods for finding all the roots of cubic and fourth degree polynomi¬ 
als. However, these methods are difficult to use. 

Direct methods for finding the roots of polynomial equations of degree greater than 4 or 
transcendental equations are not available in literature. 
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Iterative methods These methods are based on the idea of successive approximations. We 
start with one or two initial approximations to the root and obtain a sequence of approxima¬ 
tions x 0 , x 1 . x k , ..., which in the limit as k —> converge to the exact root a. An iterative 

method for finding a root of the equation fix) = 0 can be obtained as 

x k + 1 = §ix k ), k = 0,1,2 . (1.5) 

This method uses one initial approximation to the root x 0 . The sequence of approxima¬ 
tions is given by 

x 1 = c>(jc 0 ), x 2 = x 3 = (j)(x 2 ),. 

The function § is called an iteration function and x 0 is called an initial approximation. 

If a method uses two initial approximations x 0 , x 1 , to the root, then we can write the 
method as 

x k + i = $( x k-i> x i)> & = 1 > 2 >. (1-6) 

Convergence of iterative methods The sequence of iterates, {x ft }, is said to converge to the 
exact root a, if 

lim x. = a, or lim|x.-a| = 0. (1.7) 

A^OO * * 

The error of approximation at the kth. iterate is defined as £ k = x k - a. Then, we can 
write (1.7) as 

^lim | error of approximation | = lim | x k - a | = ^lim | £ k | = 0. 

Remark 2 Given one or two initial approximations to the root, we require a suitable iteration 
function <|> for a given function fix), such that the sequence of iterates, [x k ), converge to the 
exact root a. Further, we also require a suitable criterion to terminate the iteration. 
Criterion to terminate iteration procedure Since, we cannot perform infinite number of 
iterations, we need a criterion to stop the iterations. We use one or both of the following 
criterion: 

(i) The equation fix) = 0 is satisfied to a given accuracy or f(x k ) is bounded by an error 
tolerance e. 

| f ixf) | < e. (1.8) 

Hi) The magnitude of the difference between two successive iterates is smaller than a given 
accuracy or an error bound e. 

I x * + i _x *l- 8 - d-9) 

Generally, we use the second criterion. In some very special problems, we require to use 
both the criteria. 

For example, if we require two decimal place accuracy, then we iterate until | x k+1 - x k | 
< 0.005. If we require three decimal place accuracy, then we iterate until | x k+1 - x k \ < 0.0005. 

As we have seen earlier, we require a suitable iteration function and suitable initial 
approximation(s) to start the iteration procedure. In the next section, we give a method to find 
initial approximation(s). 
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1.1.2 Initial Approximation for an Iterative Procedure 

For polynomial equations, Descartes’ rule of signs gives the bound for the number of positive 
and negative real roots. 

( i ) We count the number of changes of signs in the coefficients of P n lx) for the equation fix) = 
P n (x) = 0. The number of positive roots cannot exceed the number of changes of signs. For 
example, if there are four changes in signs, then the equation may have four positive roots or 
two positive roots or no positive root. If there are three changes in signs, then the equation 
may have three positive roots or definitely one positive root. (For polynomial equations with 
real coefficients, complex roots occur in conjugate pairs.) 

( ii) We write the equation fl- x) = P n (- x) = 0, and count the number of changes of signs in the 
coefficients of P n (- x). The number of negative roots cannot exceed the number of changes of 
signs. Again, if there are four changes in signs, then the equation may have four negative 
roots or two negative roots or no negative root. If there are three changes in signs, then the 
equation may have three negative roots or definitely one negative root. 

We use the following theorem of calculus to determine an initial approximation. It is 
also called the intermediate value theorem. 

Theorem 1.1 If fix) is continuous on some interval [a, b\ and fla)flb) < 0, then the equation 
fix) = 0 has at least one real root or an odd number of real roots in the interval la, b). 

This result is very simple to use. We set up a table of values of f (x) for various values 
of x. Studying the changes in signs in the values of f (x), we determine the intervals in which 
the roots lie. For example, if f ID and fl 2) are of opposite signs, then there is a root in the 
interval (1, 2). 

Let us illustrate through the following examples. 

Example 1.1 Determine the maximum number of positive and negative roots and intervals of 
length one unit in which the real roots lie for the following equations, 
li) 8x 3 - 12x 2 - 2x + 3 = 0 Hi) 3x 3 - 2x 2 - x - 5 = 0. 

Solution 

li) Let fix) = 8x 3 - 12x 2 - 2x + 3 = 0. 

The number of changes in the signs of the coefficients (8, - 12, - 2, 3) is 2. Therefore, the 
equation has 2 or no positive roots. Now, fl-x) = - 8x 3 - 12x 2 + 2x + 3. The number of changes 
in signs in the coefficients (- 8, - 12, 2, 3) is 1. Therefore, the equation has one negative root. 
We have the following table of values for fix), (Table 1.1). 


Table 1.1. Values of f (x), Example 1.1 (/). 


X 

-2 

- 1 

0 

1 

2 

3 

fix) 

- 105 

- 15 

3 

-3 

15 

105 


Since 

fl- 1) fl 0) < 0, there is a root in the interval (- 1, 0), 
fl 0) /(l) < 0, there is a root in the interval (0, 1), 
/(l) fl 2) < 0, there is a root in the interval (1, 2). 
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Therefore, there are three real roots and the roots lie in the intervals (- 1, 0), (0, 1), (1, 2). 
iii) Let /(x) = 3x 2 - 2x 2 - x - 5 = 0. 

The number of changes in the signs of the coefficients (3, - 2, - 1, - 5 ) is 1. Therefore, 
the equation has one positive root. Now, f{-x) = - 3x 2 - 2x 2 + x - 5 . The number of changes in 
signs in the coefficients (- 3, - 2, 1, - 5 ) is 2. Therefore, the equation has two negative or no 
negative roots. 

We have the table of values for fix), (Table 1.2). 


Table 1.2. Values of fix), Example 1 . 1 ( h ). 


X 

-3 

-2 

- 1 

0 

1 

2 

3 

Ax ) 

- 101 

-35 

-9 

-5 

-5 

9 

55 


From the table, we find that there is one real positive root in the interval (1, 2). The 
equation has no negative real root. 

Example 1.2 Determine an interval of length one unit in which the negative real root, which is 
smallest in magnitude lies for the equation 9x 3 + 18x 2 - 37x - 70 = 0. 

Solution Let fix ) = 9x 3 + 18x 2 - 37x - 70 = 0. Since, the smallest negative real root in magni¬ 
tude is required, we form a table of values for x < 0, (Table 1.3). 


Table 1.3. Values of f(x), Example 1.2. 


X 

-5 

-4 

-3 

-2 

- 1 

0 

Ax) 

-560 

-210 

-40 

4 

-24 

-70 


Since, /(- 2)fi- 1) < 0, the negative root of smallest magnitude lies in the interval 

(- 2 , - 1 ). 

Example 1.3 Locate the smallest positive root of the equations 
( i ) xe x = cos x. iii) tan x = 2x. 

Solution 

ii) Let fix) = xe x - cos x = 0. We have/(0) = - 1, /(l) = e - cos 1 = 2.718 - 0.540 = 2.178. Since, 
fi 0) fi 1) < 0, there is a root in the interval (0, 1). 

iii) Let fix) = tan x - 2x = 0. We have the following function values. 

fi 0) = 0, /(0.1) = - 0.0997, fi0.5) = - 0.4537, 

/(l) = - 0.4426, fil, 1) = - 0.2352, fil.2) = 0.1722. 

Since, /(l.l) fil.2) < 0, the root lies in the interval (1.1, 1.2). 

Now, we present some iterative methods for finding a root of the given algebraic or 
transcendental equation. 

We know from calculus, that in the neighborhood of a point on a curve, the curve can be 
approximated by a straight line. For deriving numerical methods to find a root of an equation 
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fix ) = 0, we approximate the curve in a sufficiently small interval which contains the root, by 
a straight line. That is, in the neighborhood of a root, we approximate 
fix) ~ ax + b, a * 0 

where a and b are arbitrary parameters to be determined by prescribing two appropriate 
conditions on fix ) and/or its derivatives. Setting ax + b = 0, we get the next approximation to 
the root as x = — b/a. Different ways of approximating the curve by a straight line give different 
methods. These methods are also called chord methods. Method of false position (also called 
regula-falsi method) and Newton-Raphson method fall in this category of chord methods. 


1.1.3 Method of False Position 

The method is also called linear interpolation method or chord method or regula-falsi method. 

At the start of all iterations of the method, we require the interval in which the root 
lies. Let the root of the equation fix) = 0, lie in the interval ix k v x k ), that is, f h l f k < 0, where 
fix k l ) = f kv and fixf) = f k . Then, Pix kl f k _f), Qix k f k ) are points on the curve fix) = 0. Draw a 
straight line joining the points P and Q (Figs. 1.2a, b). The line PQ is taken as an approxima¬ 
tion of the curve in the interval [x k _ v x k \. The equation of the line PQ is given by 

y-fk x-x k 

fk-l-fk x k-l~ x k 

The point of intersection of this line PQ with the x-axis is taken as the next approxima¬ 
tion to the root. Setting y = 0, and solving for x, we get 



The next approximation to the root is taken as 


x k + i = x k 


x k ~ x k-i 

jk-fk -1 


\f. 


Simplifying, we can also write the approximation as 


( 1 . 10 ) 


**+1 = 


x k(fk - fk-i>~( x k ~ x k~iVk _ x k~ifk ~ x kfk -1 


fk - fk -1 


fk-fk-1 


Therefore, starting with the initial interval (x Q , xf), in which the root lies, 


k = 1,2, ... ( 1 . 11 ) 

we compute 


*2 = 


x ofi~ x ifo 

fi-fo 


Now, if/(x 0 ) fix 2 ) < 0, then the root lies in the interval (x 0 , x 2 ). Otherwise, the root lies in 
the interval (x 2 , x x ). The iteration is continued using the interval in which the root lies, until 
the required accuracy criterion given in Eq.(1.8) or Eq.(1.9) is satisfied. 

Alternate derivation of the method 

Let the root of the equation fix) = 0, lie in the interval (x k l , x k ). Then, Pix k l , f k _f), Qix k , f k ) 
are points on the curve fix) = 0. Draw the chord joining the points P and Q (Figs. 1.2a, b). We 
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approximate the curve in this interval by the chord, that is,/(x) ~ax+b. The next approximation 
to the root is given by x = - b/a. Since the chord passes through the points P and Q, we get 
f kl = ax kl + b, and f k = ax k + b. 

Subtracting the two equations, we get 


fk -fk-i = a(x h - x k-i)’ or a = 

The second equation gives b = f k - ax k . 

Hence, the next approximation is given by 



Fig. 1.2a ‘Method of false position’ Fig. 1.2b ‘Method of false position’ 

Remark 3 At the start of each iteration, the required root lies in an interval, whose length is 
decreasing. Hence, the method always converges. 

Remark 4 The method of false position has a disadvantage. If the root lies initially in the 
interval (x 0 , x x ), then one of the end points is fixed for all iterations. For example, in Fig. 1.2a, 
the left end point x 0 is fixed and the right end point moves towards the required root. There¬ 
fore, in actual computations, the method behaves like 

* = 1 . 2 .... ( 1 . 12 ) 

Tk ~ To 

In Fig.l.2b, the right end point x x is fixed and the left end point moves towards the 
required root. Therefore, in this case, in actual computations, the method behaves like 

* = 1 ' 2 "" a- 1 ® 

Remark 5 The computational cost of the method is one evaluation of the function f(x), for 
each iteration. 

Remark 6 We would like to know why the method is also called a linear interpolation method. 
Graphically, a linear interpolation polynomial describes a straight line or a chord. The linear 
interpolation polynomial that fits the data (x k v f k _ x ), (x k , f k ) is given by 
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flx) = 


- 4-1 + , 


—/*• 


(We shall be discussing the concept of interpolation polynomials in Chapter 2). 
Setting fix) = 0, we get 


^x-x k _ 1 )f k -(x-x k )f k _ 1 

x k ~ x k-i 


or x(f k - f k _f) = x k _ x f k ~x k f k _ x 


x k-ifk ~ x kfk -1 

° r x = x k + i = fk-f k -x ’ 

This gives the next approximation as given in Eq. (1.11). 

Example 1.4 Locate the intervals which contain the positive real roots of the equation x 3 - 3x 
+ 1 = 0. Obtain these roots correct to three decimal places, using the method of false position. 

Solution We form the following table of values for the function fix). 



0 

1 

2 

3 

fix) 

1 

- 1 

3 

19 


There is one positive real root in the interval (0, 1) and another in the interval (1, 2). 
There is no real root for x > 2 as fix) > 0, for all x > 2. 

First, we find the root in (0, 1). We have 

x 0 = 0, Xj = 1, f 0 = flx 0 ) = fl 0) = 1 ,f 1 = flxf) = fl 1) = - 1. 

_ x ofi ~ x ifo _ 0-1 
*2- f x -f 0 '-1-1 = 

Since, f(0) fl 0.5) < 0, the root lies in the interval (0, 0.5). 

_ *o/~2 ~ x 2fo _ 0 ~ 0-5(1) 

* 3 ' h~f o -0.375-1 

Since, /(0) /(0.36364) < 0, the root lies in the interval (0, 0.36364). 

. _ *o/s -*/o _ 0-0.36364(1) 

* 4 “ h~h “ -0.04283-1 = 

Since, fiO) /(0.3487) < 0, the root lies in the interval (0, 0.34870). 

Xoft-xJo _ 0-0.3487(1) 
ft-fo ”-0.00370-1 1 

Since, /( 0) /(0.34741) < 0, the root lies in the interval (0, 0.34741). 


= 0.5, f[x 2 ) = fl 0.5) = - 0.375. 


= 0.36364, flx 3 ) = /(0.36364) = - 0.04283. 


= 0.34870, flx 4 ) =/(0.34870) = - 0.00370. 


= 0.34741, flx 5 ) =/(0.34741) = - 0.00030. 


*o4-*/o = 0-0-34741(1) = 0347306 
fs - fo ~ 0.0003 -1 
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Now, | * 6 - * 5 | = | 0.347306 - 0.34741 | • 0.0001 < 0.0005. 

The root has been computed correct to three decimal places. The required root can be 
taken as x ~ x 6 = 0.347306. We may also give the result as 0.347, even though x 6 is more 
accurate. Note that the left end point x = 0 is fixed for all iterations. 

Now, we compute the root in (1, 2). We have 

x 0 = 1, = 2, f 0 = /(x 0 ) =/ll) = - 1, f x = fbj = H 2) = 3. 

x 2 = X ° f r X /° = 3 ~ 2 . ( ~^ = 1.25, fl* 2 ) = /U.25) = - 0.796875. 
ti~ to 3(1) 

Since,/(1.25)/(2) < 0, the root lies in the interval (1.25,2). We use the formula given in Eq.(1.13). 


* = = 1.25(3)-2(-0.796875) = 14Q74Q7 

3 fi~f 2 3-(-0.796875) 

f{x 3 ) = /(1.407407) = - 0.434437. 

Since, /(l.407407) f{ 2) < 0, the root lies in the interval (1.407407, 2). 

* = _ 1-407407(3) -2(- 0.434437) = ^ 

4 ft-fa 3-(-0.434437) 

/(x 4 ) = /(l.482367) = - 0.189730. 

Since /(1.482367) /(2) < 0, the root lies in the interval (1.482367, 2). 

_ x 4 A - XiA 1-482367(3) - 2(- 0.18973) _ 

A-A 3-(-0.18973) 1-513156, 

/(x 5 ) = /(l.513156) = - 0.074884. 

Since, /(1.513156) /(2) < 0, the root lies in the interval (1.513156, 2). 

xs/i-x/g 1.513156(3)-2(-0.074884) 

6 “ A-A ” 3-(-0.74884) - L525 ° 12 ’ 

/(x 6 ) = /(1.525012) = - 0.028374. 

Since, /(1.525012) /(2) < 0, the root lies in the interval (1.525012, 2). 

= - »i / 6 _ 1-525012(3) - 2(- 0.028374) = 

7 A-A 3-(-0.028374) 

Ax 7 ) = /U-529462) = - 0.010586. 

Since, /(l.529462) /(2) < 0, the root lies in the interval (1.529462, 2). 


X 7 A-X /7 1-529462(3)-2(-0.010586) 

X8_ A-A ~ 3 -(- 0.010586) 

Ax 8 ) = /U-531116) = - 0.003928. 

Since, /(l.531116) /(2) < 0, the root lies in the interval (1.531116, 2). 
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_ x/i-x / 8 _ 1.531116(3) -2(- 0.003928) 
* 9_ A "As ~ 3-(-0.003928) 

/(x 9 ) = /(l.531729) = - 0.001454. 

Since, /(1.531729) /(2) < 0, the root lies in the interval (1.531729, 2). 


= * 9 A = 1.531729(3) - 2(- 0.001454) = 

Xl ° A “A Z' 3-(-0.001454) 


Now, |x 10 - x 9 | = | 1.531956 - 1.53179 | « 0.000227 < 0.0005. 

The root has been computed correct to three decimal places. The required root can be 
taken as x ~ x 10 = 1.531956. Note that the right end point x = 2 is fixed for all iterations. 

Example 1.5 Find the root correct to two decimal places of the equation xe x = cos x, using the 
method of false position. 

Solution Define fix) = cos x - xe* = 0. There is no negative root for the equation. We have 
/TO) = 1, /(l) = cos 1 - e = - 2.17798. 

A root of the equation lies in the interval (0, 1). Let x 0 = 0, x 1 = 1. Using the method of 
false position, we obtain the following results. 


x 0 fi-x 1 f 0 _ 0 - 1 ( 1 ) 
fi-fo -2.17798-1 


= 0.31467, 


/( x 2 )=/( 0 . 31467 ) = 0 . 51986 . 


Since, /(0.31467) /(l) < 0, the root lies in the interval (0.31467, 1). We use the formula given in 
Eq.(1.13). 


x 2 /i -x / 2 _ 0.31467(- 2.17798) -1(0.51986) 
* 3_ f x -f 2 ~~ -2.17798-0.51986 

/(x 3 ) = /(0.44673) = 0.20354. 

Since, /X0.44673) /(l) < 0, the root lies in the interval (0.44673, 1). 


_ *®fy~ x ifs _ 0-44673(- 2,17798)- 1(0.20354) 
%4 ~ fi-fs ~ -2.17798-0.20354 

/(x 4 ) = /(0.49402) = 0.07079. 

Since, /’(0.49402) /(l) < 0, the root lies in the interval (0.49402, 1 ). 


x 


5 


A-A 


0.49402(- 2.17798) - 1(0.07079) 
-2.17798-0.07079 


= 0.50995, 


/(x 5 ) = /(0.50995) = 0.02360. 

Since, f( 0.50995) /(1) < 0, the root lies in the interval (0.50995, 1). 


_ « 6 A ~ *iA _ 0.50995(- 2,17798) - 1(0.0236) 
X6_ A" A -2.17798-0.0236 

/(x 6 ) = /(0.51520) = 0.00776. 
















SOLUTION OF EQUATIONS AND EIGEN VALUE PROBLEMS 


11 


Since, /(0.51520) /(l) < 0, the root lies in the interval (0.51520, 1). 

_ - xj 6 _ 0.5152C- 2,17798) - 1(0.00776) _ 51g92 

* 7 f x -U -2.17798-0.00776 

Now, \x 1 -x 6 \ = \ 0.51692 - 0.51520 | - 0.00172 < 0.005. 

The root has been computed correct to two decimal places. The required root can be 
taken as x » x 7 = 0.51692. 

Note that the right end point x = 2 is fixed for all iterations. 


1.1.4 Newton-Raphson Method 

This method is also called Newton’s method. This method is also a chord method in which we 
approximate the curve near a root, by a straight line. 

Let x 0 be an initial approximation to the root 
of fix) = 0. Then, P{x 0 , f 0 ), where f 0 = /(x 0 ), is a point on 
the curve. Draw the tangent to the curve at P, (Fig. 

1.3). We approximate the curve in the neighborhood of 
the root by the tangent to the curve at the point P. The 
point of intersection of the tangent with the x-axis is 
taken as the next approximation to the root. The 
process is repeated until the required accuracy is 
obtained. The equation of the tangent to the curve 
y = f{x ) at the point P(x 0 , f 0 ) is given by 

y ~ fi.x 0 ) = (x - x 0 ) f'ix 0 ) 

where f'(x 0 ) is the slope of the tangent to the curve at P. Setting y = 0 and solving for x, we get 

r( * o) * 0 ' 

The next approximation to the root is given by 


yf 



Fig. 1.3 ‘Newton-Raphson method’ 


A*,)’ r(Xo> * 0 ' 

We repeat the procedure. The iteration method is defined as 


= x k~j^y o- (L14) 

This method is called the Newton-Raphson method or simply the Newton’s method. 
The method is also called the tangent method. 

Alternate derivation of the method 

Let x k be an approximation to the root of the equation fix) = 0. Let Ax be an increment in 
x such that x k + Ax is the exact root, that is fix k + Ax) = 0. 
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Expanding in Taylor’s series about the point x k , we get 
(Ax ) 2 

fix k ) + Axf'(x k ) + 2 , f" ( x k ) + ... = 0. (1.15) 

Neglecting the second and higher powers of Ax, we obtain 

f[x k ) + Ax f\x k ) = 0, or Ax = - \ . 

f%x k ) 

Hence, we obtain the iteration method 

x k + i = x k + Ax = x k ~ f'(x k )* 0 , k = 0,1,2, ... 

which is same as the method derived earlier. 

Remark 7 Convergence of the Newton’s method depends on the initial approximation to the 
root. If the approximation is far away from the exact root, the method diverges (see Example 
1.6). However, if a root lies in a small interval (a, b ) and x Q e (a, b), then the method converges. 
Remark 8 From Eq.(1.14), we observe that the method may fail when f'(x) is close to zero in 
the neighborhood of the root. Later, in this section, we shall give the condition for convergence 
of the method. 

Remark 9 The computational cost of the method is one evaluation of the function fix) and one 
evaluation of the derivative f'(x), for each iteration. 

Example 1.6 Derive the Newton’s method for finding UN, where N > 0. Hence, find HY1, 
using the initial approximation as (i) 0.05, (ii) 0.15. Do the iterations converge ? 


Solution Let x = -J-, or — = N. Define fix) = - - N. Then, f'(x) = - -L. 

N x x x 

Newton’s method gives 


x k + i= x k~ 


f'(x k ) ~ k 


[Odx k )-m 


= x k + [x k - Nx% 1 = 2 x*. - Nx 2 • 


( i ) With N = 17, and x 0 = 0.05, we obtain the sequence of approximations 
x x = 2x 0 - Nxg = 2(0.05) - 17(0.05) 2 = 0.0575. 
x 2 = 2x 1 - Nxl = 2(0.0575) - 17(0.0575) 2 = 0.058794. 
x 3 = 2x 2 - Nx\ = 2(0.058794) - 17(0.058794) 2 = 0.058823. 
x 4 = 2 x 3 - Nxl = 2(0.058823) - 17(0.058823) 2 = 0.058823. 


Since, I x 4 - x 3 | = 0, the iterations converge to the root. The required root is 0.058823. 
(ii) With N = 17, and x 0 = 0.15, we obtain the sequence of approximations 


x 1 = 2x 0 - Nxl = 2(0.15) - 17(0.15) 2 = - 0.0825. 
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x 2 = 2x 1 - Nxf = 2(- 0.0825) - 17(- 0.8025) 2 = - 0.280706. 

x 3 = 2x 2 - Nxl = 2(— 0.280706) - 17(- 0.280706) 2 = - 1.900942. 

x 4 = 2x 3 - Nxl = 2(— 1.900942) - 17(- 1.900942) 2 = - 65.23275. 

We find that x k —» - °° as k increases. Therefore, the iterations diverge very fast. This 
shows the importance of choosing a proper initial approximation. 

Example 1.7 Derive the Newton’s method for finding the qth root of a positive number N, N 1/q , 
where N > 0, q > 0. Hence, compute 17 1/3 correct to four decimal places, assuming the initial 
approximation as x 0 = 2. 

Solution Let x = N 1/q , or x q = N. Define fix) = x q - N. Then, f’(x) = qx q ~ A . 

Newton’s method gives the iteration 

_x q k -N _qxl~x q k +N _{q- l)x q + N 

k+1 k <& V X 9**" 1 ^ r 1 

For computing 17 1/3 , we have q = 3 and N = 17. Hence, the method becomes 


2xl +17 


With x 0 = 2, we obtain the following results. 


_ 2yg+17 
3xq 


2(8)+ 17 
3(4) 


= 2.75, 


2x\ + 17 _ 2(2.75) 3 + 17 
3xf ~ 3(2.75) 2 


= 2.582645, 


x 


3x| 


2(2.582645) 3 +17 
3(2.582645) 2 


= 2.571332, 


x 4 = 


2xj +17 
3xf 


2(2.571332) 3 +17 
3(2.571332) 2 


= 2.571282. 


Now, | x 4 - x 3 | = | 2.571282 - 2.571332 | = 0.00005. 

We may take x = 2.571282 as the required root correct to four decimal places. 


Example 1.8 Perform four iterations of the Newton’s method to find the smallest positive root 
of the equation f(x) = x 3 - 5x + 1 = 0. 

Solution We have f{ 0) = 1, /(l) = - 3. Since, /TO) /(l) < 0, the smallest positive root lies in the 
interval (0, 1). Applying the Newton’s method, we obtain 


**+i = x h ~ 


x k - 5x k + 1 


2x s k -l 

3xl-i* 


k = 0, 1, 2, ... 


3xf -5 
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Let x 0 = 0.5. We have the following results. 

fag A 2(0.5)°-! .Q 

1 3xo-5 3(0.5) 2 - 5 

2*i - 1 2(0.176471) 3 - 1 

x„ = —s 5 - = 0.201568, 

2 3xi-5 3(0.176471) 2 - 5 

3 3*f-5 3(0.201568) 2 - 5 

2*| - 1 2(0.201640) 3 - 1 

x, = —I = — 4 = 0.201640. 

4 3*f-5 3(0.201640) 2 - 5 

Therefore, the root correct to six decimal places is * ® 0.201640. 

Example 1.9 Using Newton-Raphson method solve x log 10 x = 12.34 with x 0 = 10. 

(A.U. Apr /May 2004) 

Solution Define fix) = x log 10 x - 12.34. 


Then 


f'(x) = log in x + --— = log in x + 0.434294. 

log e 10 


Using the Newton-Raphson method, we obtain 


_ x, log 10 *ft -12,34 , 

1 k log 10 x k + 0.434294 ’ ’ ’ ’ ' 


With x 0 = 10, we obtain the following results. 

*o log ip *o ~ 12.34 


10 login 10-12.34 


_ - — -= 10-^ : = 11.631465. 

n log 10 *o + 0.434294 log 10 10 + 0.434294 


*1 log 10 xj - 12.34 


log 10 x 1 + 0.434294 
L.631465 lc 

logm U.631465 + 0.434294 


x _ x x 2 tog aj»2 ~ 12-34 
3 2 log 10 x 2 + 0.434294 


11.59487 logm 11-59487 - 12.34 
logm U.59487 + 0.434294 


= 11.594854. 


We have | x 3 - x 2 | = | 11.594854 - 11.594870 | = 0.000016. 

We may take x = 11.594854 as the root correct to four decimal places. 
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1.1.5 General Iteration Method 

The method is also called iteration method or method of successive approximations or fixed 
point iteration method. 

The first step in this method is to rewrite the given equation fix) = 0 in an equivalent 
form as 

* = <Kx). (1.16) 

There are many ways of rewriting fix) = 0 in this form. 

For example, fix) = x 3 - 5x + 1 = 0, can be rewritten in the following forms. 


= (5* - l) 173 , x 


(1.17) 


Now, finding a root of fix) = 0 is same as finding a number a such that a = tJ>(ot), that is, 
a fixed point of t|>(jc). A fixed point of a function <j> is a point a such that a = This result is 
also called the fixed point theorem. 

Using Eq.(1.16), the iteration method is written as 

x k+ i = <K**), A = °, i, 2, ... (1.18) 

The function <|)(x) is called the iteration function. Starting with the initial approxima¬ 
tion x 0 , we compute the next approximations as 

x 1 = <t>(jc 0 ), x 2 = (f^X-,), x 3 = <\>(x 2 ),... 

The stopping criterion is same as used earlier. Since, there are many ways of writing 
fix) = 0 as x = <J)(x), it is important to know whether all or at least one of these iteration 
methods converges. 

Remark 10 Convergence of an iteration method x k+1 = §(x k ), k = 0, 1, 2,..., depends on the 
choice of the iteration function <)>(jc), and a suitable initial approximation x 0 , to the root. 

Consider again, the iteration methods given in Eq.(1.17), for finding a root of the equation 
fix) = x 3 - 5x + 1 = 0. The positive root lies in the interval (0, 1). 

(i) x k+1 =^^,k = 0,l,2,... (1.19) 

With x 0 = 1, we get the sequence of approximations as 

x x = 0.4, x 2 = 0.2128, x 3 = 0.20193, x 4 = 0.20165, x 5 = 0.20164. 

The method converges and x ~ x 5 = 0.20164 is taken as the required approximation to 
the root. 

(ii) x k+1 = (5x k - 1) 173 , k = 0,l, 2, ... (1.20) 

With x 0 = 1, we get the sequence of approximations as 

x x = 1.5874, x 2 = 1.9072, x 3 = 2.0437, x 4 = 2.0968,... 
which does not converge to the root in (0, 1). 


(iii) 


x 



,k = 0,l, 2 ,... 


c k+i ~ 


( 1 . 21 ) 
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With x 0 = 1, we get the sequence of approximations as 

x 1 = 2.0, x 2 = 2.1213, x 3 = 2.1280, x 4 = 2.1284,... 
which does not converge to the root in (0, 1). 

Now, we derive the condition that the iteration function <J>(jc) should satisfy in order that 
the method converges. 

Condition of convergence 

The iteration method for finding a root of fix) = 0, is written as 

x k+1 = <p(x k ), k = 0, 1, 2 ,... (1.22) 

Let a be the exact root. That is, 

a m <(>(«). (1.23) 

We define the error of approximation at the &th iterate as e k = x k — a, k = 0, 1, 2,... 
Subtracting (1.23) from (1.22), we obtain 

x k+i ~ a ~ ¥ x k ) - <!>(«) 

= lx k - a)§'{t k ) (using the mean value theorem) (1.24) 

or E k+1 = f(f*) e k , x k <t k < a. 

Setting k = k - 1, we get e k = e k l , x k l < t k l < a. 

Hence, e k+1 = §'(t k )$'(t kl ) E k v 

Using (1.24) recursively, we get 

h + i = i) - W e o- 

The initial error e 0 is known and is a constant. We have 

I e * + i I = I <W 11 f&*_i) I - I <t>'(f 0 ) I I Eq |. 

Let | §'(t k ) | < c, k = 0, 1, 2,... 

Then, | e A+1 1 < c* +1 1 e 0 1- d- 25 ) 

For convergence, we require that | £ k+1 \ —> 0 as k This result is possible, if and only 
if c < 1. Therefore, the iteration method (1.22) converges, if and only if 
| (j)'(x ft ) | < c < 1, k = 0, 1, 2, ... 

or | <j>'(x) | < c < 1, for all x in the interval (a, b). (1.26) 

We can test this condition using x 0 , the initial approximation, before the computations 
are done. 

Let us now check whether the methods (1.19), (1.20), (1.21) converge to a root in (0, 1) of 
the equation fix) = x 3 - 5x + 1 = 0. 

(i) We have (|>(x) = ———, ((/(x) = , and | ^'(x) | = 

5 5 5 

the method converges to a root in (0, 1). 


< 1 for all x in 0 < x < 1. Hence, 
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( ii ) We have (|>(x) = (5x - l) 173 , <|)'(x) = - 


. Now | <j/(x) | < 1, whenx is close to 1 and 


3(5x -1) 2/: 

| (j)'(x) | > 1 in the other part of the interval. Convergence is not guaranteed. 
1 


(iii) We have c|>(x) = 


-, <j)'(x) = - 


. Again, | <|>'(x) | < 1, when x is close to 


2x 6 2 (5x -1;' 

1 and | <])'(x) | > 1 in the other part of the interval. Convergence is not guaranteed. 


Remark 11 Sometimes, it may not be possible to find a suitable iteration function (|>(x) by 
manipulating the given function fix). Then, we may use the following procedure. Write 
fix) = 0as x = x + a fix) = <|>(x), where a is a constant to be determined. Let x 0 be an initial 
approximation contained in the interval in which the root lies. For convergence, we require 
| f(x 0 ) | = | 1 + af\x 0 ) | < 1. (1.27) 

Simplifying, we find the interval in which a lies. We choose a value for a from this 
interval and compute the approximations. A judicious choice of a value in this interval may 
give faster convergence. 

Example 1.10 Find the smallest positive root of the equation x 3 - x - 10 = 0, using the general 
iteration method. 

Solution We have 

fix) = X 3 - X - 10, /TO) = - 10, HD = - 10, 
f(2) = 8 - 2 - 10 = - 4, /(3) = 27 - 3 - 10 = 14. 

Since, f( 2) /(3) < 0, the smallest positive root lies in the interval (2, 3). 

Write x 3 = x + 10, and x = (x + 10) 173 = <>(x). We define the iteration method as 
X&+1 “ ( x k + 10) 1/3 - 


We obtain d>'(x) =-. 

3(x +10) 2/3 

We find | (|>'(x) | < 1 for all x in the interval (2, 3). Hence, the iteration converges. 

Let x 0 = 2.5. We obtain the following results. 

x 1 = (12.5) 173 = 2.3208, x 2 = (12.3208) 173 = 2.3097, 
x 3 = (12.3097) 173 = 2.3090, x 4 = (12.3090) 173 = 2.3089. 

Since, | x 4 - x 3 | = 2.3089 - 2.3090 | = 0.0001, we take the required root as x « 2.3089. 

Example 1.11 Find the smallest negative root in magnitude of the equation 
3x 4 + x 3 + 12x + 4 = 0, using the method of successive approximations. 

Solution We have 

fix) = 3x 4 + x 3 + 12x + 4 = 0, /TO) = 4, f(- 1) = 3 - 1 - 12 + 4 = - 6. 

Since, fl— 1) fl 0) < 0, the smallest negative root in magnitude lies in the interval (- 1, 0). 
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= <|>(x). 


We obtain 



We find | <|)'(x) | < 1 for all x in the interval (- 1, 0). Hence, the iteration converges. 


Let x 0 = - 0.25. We obtain the following results. 

4 


= - 0.33290, 


3(- 0.25) 3 + (- 0.25) 2 + 12 


4 


= - 0.33333, 


3(- 0.3329) 3 + (- 0.3329) 2 + 12 


4 


= - 0.33333. 


3(- 0.33333) 8 + (- 0.33333) 2 + 12 


The required approximation to the root is x ~ - 0.33333. 

Example 1.12 The equation f(x) - 3x 3 + 4x 2 + 4x + 1 = 0 has a root in the interval (- 1, 0). 
Determine an iteration function §(x), such that the sequence of iterations obtained from 
x k+1 = §{x k ), x Q = — 0.5, k = 0, 1,..., converges to the root. 

Solution We illustrate the method given in Remark 10. We write the given equation as 
x = x + a (3x 3 + 4x 2 + 4x + 1) = <j)(x) 
where a is a constant to be determined such that 


| <Jf(x) | = | 1 + a f\x) | 

= | 1 + a (9x 2 + 8x + 4) | < 1 


for allx e (- 1, 0). This condition is also to be satisfied at the initial approximation. Setting x 0 
= - 0.5, we get 


| (^'(xq) | = | 1 + af\xf) | = 1+ — < 1 
4 


i 8 

<1 or-<a<0. 



or 


9 


Hence, a takes negative values. The interval for a depends on the initial approximation 
x 0 . Let us choose the value a = - 0.5. We obtain the iteration method as 


= x k - 0.5 (3x k 3 + 4x k 2 + 4x^ + 1) 
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= - 0.5 (3x ft 3 + 4x| + 2x k + 1) = 6}(x k ). 

Starting with x 0 = - 0.5, we obtain the following results. 

x 1 = <|>(x 0 ) = - 0.5 (3x 0 3 + 4xfi + 2x 0 + 1) 

= - 0.5 [3(- 0.5) 3 + 4(- 0.5) 2 + 2(— 0.5) + 1] = - 0.3125. 
x 2 = (fjfacj) = - 0.5(3*^ + 4x 2 + 2x 1 + 1) 

= - 0.5[3(- 0.3125) 3 + 4(- 0.3125) 2 + 2(- 0.3125) + 1] = - 0.337036. 
x 3 = <|>(x 2 ) = - 0.5(3x| + 4x| + 2x 2 + 1) 

= - 0.5[3 (- 0.337036) 3 + 4(- 0.337036) 2 + 2(- 0.337036) + 1] = - 0.332723. 
x 4 = 4>(x 3 ) = - 0.5(3x 3 + 4xf + 2x 3 + 1) 

= - 0.5[3(- 0.332723) 3 + 4(- 0.332723) 2 + 2(- 0.332723) + 1] = - 0.333435. 
x s = (|>(x 4 ) = - 0.5(3x 4 3 + 4xf + 2 x 4 + 1) 

= - 0.5[3(- 0.333435) 8 + 4(- 0.333435) 2 + 2(- 0.333435) + 1] = - 0.333316. 
Since | x 5 - x 4 | = | - 0.333316 + 0.333435 | = 0.000119 < 0.0005, the result is correct to 
three decimal places. 

We can take the approximation as x = x 5 = - 0.333316. The exact root is x = - 1/3. 

We can verify that | <|>'(*p | < 1 for all j. 


1.1.6 Convergence of the Iteration Methods 

We now study the rate at which the iteration methods converge to the exact root, if the initial 
approximation is sufficiently close to the desired root. 

Define the error of approximation at the kth. iterate as £ k = x k - a, k = 0, 1, 2,... 

Definition An iterative method is said to be of order p or has the rate of convergence p, if p is 
the largest positive real number for which there exists a finite constant C * 0, such that 

| e k+1 ( :£ C | e k \ p . (1.28) 

The constant C, which is independent of k, is called the asymptotic error constant and it 
depends on the derivatives of fix) at x = a. 

Let us now obtain the orders of the methods that were derived earlier. 

Method of false position We have noted earlier (see Remark 4) that if the root lies initially 
in the interval (x 0 , x 4 ), then one of the end points is fixed for all iterations. If the left end point 
x 0 is fixed and the right end point moves towards the required root, the method behaves like 
(see Fig. 1.2a) 


x 


k+i ~ 


*o fk ~ x kfo 

fk-fo 


Substituting x k = e k + a, x k+1 = e k+1 + a, x 0 = e 0 + a, we expand each term in Taylor’s 
series and simplify using the fact that /(a) = 0. We obtain the error equation as 


h + i = CE oh> where C = 


f"(a) 

2f'ia)' 
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Since e 0 is finite and fixed, the error equation becomes 

I h + i I = I C* 11 e k |, where C* = Ce 0 . (1.29) 

Hence, the method of false position has order 1 or has linear rate of convergence. 

Method of successive approximations or fixed point iteration method 
We have x k+l = ()>(x A ), and a = (|>(a) 

Subtracting, we get 

x k+1 -a = <)>(%) - <t>(oc) = (>(ot + x k - a) - c>(ot) 

= [<t>(a) + (x k - a ) + ...]- 

or £ k+1 = E k $'(a) + 0(e|). 

Therefore, | e /S , +1 1 = C \ e k |„ x k <t k < a, and C = | (j)'(a) |. (1.30) 

Hence, the fixed point iteration method has order 1 or has linear rate of convergence. 


Newton-Raphson method 

The method is given by 


x k + i = x k 


Aacjfc) 

n* k y 


f\x k )± 0. 


Substituting x k = e k + a, x k+1 = £ k+1 + a, we obtain 


+- a = e, + a - 


f(z k + a) 
f'(E k + a)' 


Expand the terms in Taylor’s series. Using the fact that/(a) = 0, and canceling/"'(a), we 

obtain 


^E k f'(a) + ^e 2 k /""(a) + ...j 

f'(a) + E k f"(d) 


1 f"(u) 2 

= E »-[ Ek+ w^ ek+ - 


r f"(a) 2 
=^-[ Ek+ w^ Ek+ - 


c r f"{ a) 2 

1 noo e2 + 

* l ek ~mv) Ek " 

1 2f\a) k 


Neglecting the terms containing e| and higher powers of £ k , we get 
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and 


|e* +1 l = |C||e* I 2 . 


(1.31) 


Therefore, Newton’s method is of order 2 or has quadratic rate of convergence. 

Remark 12 What is the importance of defining the order or rate of convergence of a method ? 
Suppose that we are using Newton’s method for computing a root of fix) = 0. Let us assume 
that at a particular stage of iteration, the error in magnitude in computing the root is 10 -1 = 
0.1. We observe from (1.31), that in the next iteration, the error behaves like C(0.1) 2 = C(10 -2 ). 
That is, we may possibly get an accuracy of two decimal places. Because of the quadratic 
convergence of the method, we may possibly get an accuracy of four decimal places in the next 
iteration. However, it also depends on the value of C. From this discussion, we conclude that 
both fixed point iteration and regula-falsi methods converge slowly as they have only linear 
rate of convergence. Further, Newton’s method converges at least twice as fast as the fixed 
point iteration and regula-falsi methods. 

Remark 13 When does the Newton-Raphson method fail ? 

(i) The method may fail when the initial approximation x 0 is far away from the exact root a 
(see Example 1.6). However, if the root lies in a small interval (a, b ) and x 0 e (a, b), then the 
method converges. 

Hi) From Eq.(1.31), we note that if f'ia) ~ 0, and f"(x) is finite then C -> °° and the method 
may fail. That is, in this case, the graph of y = fix) is almost parallel to x-axis at the root a. 
Remark 14 Let us have a re-look at the error equation. We have defined the error of approxi¬ 
mation at the&th iterate as e k =x k - a, k = 0, 1 , 2 ,... From x k+1 = §ix k ), k = 0, 1 , 2 ,... and a = (j)(a), 
we obtain (see Eq.(1.24)) 


x k+i ~ a = <K X *) - <>(«) = (|>(a + e k ) - <|>(<x) 



z k+i ~ a i E k + a 2 z k + ••• 
a 1 = ((/(a), a 2 = (l/2)c|>"(a), etc. 


(1.32) 


or 


where 


The exact root satisfies the equation a = <|)(a). 

If a 1 ^ 0 that is, <J>'(oO ^ 0, then the method is of order 1 or has linear convergence. For the 
general iteration method, which is of first order, we have derived that the condition of conver¬ 
gence is | (j)'(x) | < 1 for allx in the interval (a, b) in which the root lies. Note that in this method, 
| (j)'(x) | ^ 0 for all x in the neighborhood of the root a. 

If a 1 = <|)'(a) = 0, and a 2 = (l/2)<|)"(a) * 0, then from Eq. (1.32), the method is of order 2 or 
has quadratic convergence. 

Let us verify this result for the Newton-Raphson method. For the Newton-Raphson 
method 
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and 


<>'(«) = 


f(a)f%3 


= 0 


since f(a) = 0 and f'(a) ^ 0 (a is a simple root). 

When, x k -> a, f(x k ) -> 0, we have | §'(xf) | < 1, k = 1, 2,... and -> 0 as n -> °°. 

Now, TO = . 1 , \f '(x) {/■ '(*) f "(x) + fix) f '"(x)} -2 fix) If "(x)} 2 ] 

[/(*)] 

and <])"(a) = ^ * 0. 

/"(a) 

Therefore, a 2 ^ 0 and the second order convergence of the Newton’s method is verified. 


- ( REVIEW QUESTIONS j - 

1. Define a (i) root, Hi) simple root and liii) multiple root of an algebraic equation f(x) = 0. 

Solution 

( i ) A number a, such that /(a) = 0 is called a root of fix) = 0. 

(ii) Let a be a root of f(x) = 0. If f( a) = 0 and f '(a) * 0, then a is said to be a simple root. 
Then, we can write f(x) as 

fix) = (x-a) glx), g(a) * 0. 

(Hi) Let a be a root of fix) = 0. If 

f(a) = 0, f'(a) = 0,..., f ( - m ~ 1 '> (a) = 0, and /‘ (m) (a) * 0, 
then, a is said to be a multiple root of multiplicity m. Then, we can write fix) as 
fix) = (x - a) m glx), g(a) ± 0. 

2. State the intermediate value theorem. 

Solution If f(x) is continuous on some interval [a, b\ and f(a)f(b) < 0, then the equation 
f(x) = 0 has at least one real root or an odd number of real roots in the interval (a, b). 

3. How can we find an initial approximation to the root oif(x) = 0 ? 

Solution Using intermediate value theorem, we find an interval (a, b) which contains 
the root of the equation f(x) = 0. This implies that f(a)f(b) < 0. Any point in this interval 
(including the end points) can be taken as an initial approximation to the root of f(x) = 0. 

4. What is the Descartes’ rule of signs? 

Solution Let f(x) = 0 be a polynomial equation P n (x) = 0. We count the number of 
changes of signs in the coefficients of f (x) = P n (x) = 0. The number of positive roots 
cannot exceed the number of changes of signs in the coefficients of P n (x). Now, we write 
the equation f(- x) = P n (- x) = 0, and count the number of changes of signs in the coeffi¬ 
cients of P n (- x). The number of negative roots cannot exceed the number of changes of 
signs in the coefficients of this equation. 

5. Define convergence of an iterative method. 

Solution Using any iteration method, we obtain a sequence of iterates (approxima¬ 
tions to the root of/lx) = 0), x v x 2 ,..., x k ,... If 
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hm x k = a, or lim | x k - a | = 0 


where a is the exact root, then the method is said to be convergent. 

6. What are the criteria used to terminate an iterative procedure? 

Solution Lets be the prescribed error tolerance. We terminate the iterations when 
either of the following criteria is satisfied. 

(i) I fi* k ) | < e. Hi) | x k+1 -x k | < e. 

Sometimes, we may use both the criteria. 

7. Define the fixed point iteration method to obtain a root of/be) = 0. When does the method 
converge? 

Solution Let a root of fix) = 0 lie in the interval (a, b). Letx 0 be an initial approximation 
to the root. We write fix) = 0 in an equivalent form as x = <J)(x), and define the fixed point 
iteration method as x k+1 = (|)(x A ), k = 0, 1, 2, ... Starting with x 0 , we obtain a sequence of 
approximations x v x 2 ,..., x k ,... such that in the limit as k -> °°, x k -> a. The method 
converges when | <J/(x) | < 1, for all x in the interval (a, b). We normally check this 
condition at x Q . 

8. Write the method of false position to obtain a root of fix) = 0. What is the computational 
cost of the method? 

Solution Let a root of fix) = 0 lie in the interval (a, b). Let x 0 , x 1 be two initial approxi¬ 
mations to the root in this interval. The method of false position is defined by 


x k-ifk ~ x kfk-i 

fk-fk-i 


k = l, 2,... 


The computational cost of the method is one evaluation of fix) per iteration. 

9. What is the disadvantage of the method of false position? 

Solution If the root lies initially in the interval (x Q , x 1 ), then one of the end points is 
fixed for all iterations. For example, in Fig. 1.2a, the left end point x 0 is fixed and the 
right end point moves towards the required root. Therefore, in actual computations, the 
method behaves like 


_ _ x ofk ~ x kfo 

k+1 fk-fo 

In Fig. 1.26, the right end point x 1 is fixed and the left end point moves towards the 
required root. Therefore, in this case, in actual computations, the method behaves like 

„ _ x kfi ~ «i fk 

k+1 fx-fk 

10. Write the Newton-Raphson method to obtain a root of fix) = 0. What is the computa¬ 
tional cost of the method? 


Solution Let a root of fix) = 0 lie in the interval ia,b). Letx 0 be an initial approximation 
to the root in this interval. The Newton-Raphson method to find this root is defined by 






24 


NUMERICAL METHODS 



The computational cost of the method is one evaluation of f(x) and one evaluation of the 
derivative f'(x) per iteration. 

11. Define the order (rate) of convergence of an iterative method for finding the root of an 
equation fix) = 0. 

Solution Let a be the exact root of fix) = 0. Define the error of approximation at the &th 
iterate asE k = x k -a,k = 0, 1, 2,... An iterative method is said to be of order p or has the 
rate of convergence p, if p is the largest positive real number for which there exists a 
finite constant C ^ 0, such that 


I e *+i I - C I e * l p - 


The constant C, which is independent of k, is called the asymptotic error constant and it 
depends on the derivatives of fix) at x = a. 

12. What is the rate of convergence of the following methods: (i) Method of false position, 
(ii) Newton-Raphson method, (Hi) Fixed point iteration method? 

Solution ( i) One. (ii) Two. (Hi) One. 



In the following problems, find the root as specified using the regula-falsi method (method of 
false position). 

1. Find the positive root of x 3 = 2x + 5. (Do only four iterations). (A. U. Nov. / Dec. 2006) 

2. Find an approximate root of x log 10 x - 1.2 = 0. 

3. Solve the equation x tan x = - 1, starting with a = 2.5 and b- 3, correct to three decimal 


places. 


4. Find the root of xe x = 3, correct to two decimal places. 

5. Find the smallest positive root of x - e~ x = 0, correct to three decimal places. 

6. Find the smallest positive root of x 4 - x - 10 = 0, correct to three decimal places. 

In the following problems, find the root as specified using the Newton-Raphson method. 

7. Find the smallest positive root of x 4 - x = 10, correct to three decimal places. 

8. Find the root between 0 and 1 of x 3 = 6x - 4, correct to two decimal places. 

9. Find the real root of the equation 3x = cos x + 1. (A.U. Nov. /Dec. 2006) 

10. Find a root of x log 10 x - 1.2 = 0, correct to three decimal places. 


(A.U. Nov. /Dec. 2004) 


11. Find the root of x = 2 sin x, near 1.9, correct to three decimal places. 

12. ( i ) Write an iteration formula for finding Jn where N is a real number. 


( A.U. Nov. /Dec. 2006, A.U. Nov. /Dec. 2003) 


(ii) Hence, evaluate Vl42 , correct to three decimal places. 
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13. ( i ) Write an iteration formula for finding the value of UN, where TV is a real number. 
(ii) Hence, evaluate 1/26, correct to four decimal places. 

14. Find the root of the equation sin x = 1 + x 3 , which lies in the interval (- 2, - 1), correct to 
three decimal places. 

15. Find the approximate root of xe x = 3, correct to three decimal places. 

In the following problems, find the root as specified using the iteration method / method of 
successive approximations /fixed point iteration method. 

16. Find the smallest positive root of x 2 - 5x + 1 = 0, correct to four decimal places. 

17. Find the smallest positive root of x 5 - 64x + 30 = 0, correct to four decimal places. 

18 . Find the smallest negative root in magnitude of 3x 3 - x + 1 = 0, correct to four decimal 
places. 

19. Find the smallest positive root of x = e~ x , correct to two decimal places. 

20. Find the real root of the equation cos x = 3x - 1. (A. U. Nov. / Dec. 2006) 

21. The equation x 2 + ax + b = 0, has two real roots a and (3. Show that the iteration method 

(i) x k+1 = - (ax k + b)/x k , is convergent near x = a, if | a | > | (3 |, 

(ii) x k+1 = - b/(x k + a), is convergent near x = a, if | a | < | (3 |. 


1.2 LINEAR SYSTEM OF ALGEBRAIC EQUATIONS 

1.2.1 Introduction 

Consider a system of n linear algebraic equations in n unknowns 

a 11 x 1 + a^z + ... + a ln x n = b 1 

021*1 + °22 X 2 + - + a 2n X n = b 2 
a nl X l + a n2 X 2 + ••• + a n n X n = b n 

where ay, i = 1,2, ...,n,j= 1,2, ...,n, are the known coefficients, b i ,i= 1,2, ...,n, are the known 
right hand side values and x t , i = 1, 2, ..., n are the unknowns to be determined. 

In matrix notation we write the system as 

Ax = b (1.33) 




°11 a 12 ■ 

•• a ln~ 


*i 


v 

where 

A = 

«21 a 22 ■ 

;; 

, x = 

* 2 

, and b = 

b 2 



_ a nl a n2 ■ 

•• a nn _ 




b n 


The matrix [A | b] , obtained by appending the column b to the matrix A is called the 
augmented matrix. That is 
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a n 

Oi2 • 

•• a l n 

b i 

[A | b] = 

a 21 

a 22 • 

■■ a 2n 

b 2 


a n i 

a n2 ■ 

.. a nn 

b n 


We define the following. 

(i) The system of equations (1.33) is consistent (has at least one solution), if 

rank (A) = rank [A | b] = r. 

If r = n, then the system has unique solution. 

If r <n, then the system has in - r) parameter family of infinite number of solutions. 

(ii) The system of equations (1.33) is inconsistent (has no solution) if 

rank (A) =£ rank [A | b]. 

We assume that the given system is consistent. 

The methods of solution of the linear algebraic system of equations (1.33) may be 
classified as direct and iterative methods. 

(а) Direct methods produce the exact solution after a finite number of steps (disregarding the 
round-off errors). In these methods, we can determine the total number of operations (addi¬ 
tions, subtractions, divisions and multiplications). This number is called the operational count 
of the method. 

(б) Iterative methods are based on the idea of successive approximations. We start with an 
initial approximation to the solution vector x = x Q , and obtain a sequence of approximate 
vectors x Q , x p ..., x /; , ..., which in the limit as k -» °°, converge to the exact solution vector x. 
Now, we derive some direct methods. 


1.2.2 Direct Methods 

If the system of equations has some special forms, then the solution is obtained directly. 
We consider two such special forms. 

(a) Let A be a diagonal matrix, A = D. That is, we consider the system of equations 

Dx = b as 


a 11 x 1 

“22*2 


= b l 

= b 2 


(1.34) 


a n _i n _ 1 X n _ 1 = b n l 

a nn X n = b n 

This system is called a diagonal system of equations. Solving directly, we obtain 


x . = — , a * 0, i = 1,2, .. 

a ii 


(1.35) 


(6) Let A be an upper triangular matrix, A = U. That is, we consider the system of 
equations Ux = b as 
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a ll x l + a 12 x 2 +. + a ln x n = b 1 

a 22*2 +. +a 2n X n = b 2 


(1.36) 


a n _l n—1 X n -1 + a n -1 n X n = b n -1 
a nn X n = b n 

This system is called an upper triangular system of equations. Solving for the unknowns 
in the order x n , x nl , ..., x v we get 

X n = b rJ a nn’ 

x n _ i = (b n l - a n l n x re )/a n l n l , 



The unknowns are obtained by back substitution and this procedure is called the back 

substitution method. 

Therefore, when the given system of equations is one of the above two forms, the solution 
is obtained directly. 

Before we derive some direct methods, we define elementary row operations that can be 
performed on the rows of a matrix. 

Elementary row transformations (operations) The following operations on the rows of a 
matrix A are called the elementary row transformations ( operations ). 

(i) Interchange of any two rows. If we interchange the ith row with the jth row, then we 
usually denote the operation as R ■ <h> R -. 

(ii) Division/multiplication of any row by a non-zero number p. If the ith row is multiplied by 
p, then we usually denote this operation as pR v 

(iii) Adding/subtracting a scalar multiple of any row to any other row. If all the elements of 
the jth row are multiplied by a scalar p and added to the corresponding elements of the ith 
row, then, we usually denote this operation as R ■ R { + pR-. Note the order in which the 
operation R . + pR, is written. The elements of the jth row remain unchanged and the elements 
of the ith row get changed. 

These row operations change the form of A, but do not change the row-rank of A. The 
matrix B obtained after the elementary row operations is said to be row equivalent with A. In 
the context of the solution of the system of algebraic equations, the solution of the new system 
is identical with the solution of the original system. 

The above elementary operations performed on the columns of A (column C in place of 
row R) are called elementary column transformations (operations ). However, we shall be using 
only the elementary row operations. 
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In this section, we derive two direct methods for the solution of the given system of 
equations, namely, Gauss elimination method and Gauss-Jordan method. 

1.2.2.1 Gauss Elimination Method 

The method is based on the idea of reducing the given system of equations Ax = b, to an 
upper triangular system of equations Ux = z, using elementary row operations. We know that 
these two systems are equivalent. That is, the solutions of both the systems are identical. This 
reduced system Ux = z, is then solved by the back substitution method to obtain the solution 
vector x. 

We illustrate the method using the 3x3 system 
a n x x + a 12 x 2 + a 13 x 3 = b j 

a 21 x 1 + a 22 x 2 + a 23 x 3 = b 2 (1.38) 

a 31 x 1 + a 32 x 2 + a 33 x 3 = b 3 

We write the augmented matrix [A | b] and reduce it to the following form 
Gauss elimination 

[A|b] I: [U|z] 

The augmented matrix of the system (1.38) is 


°11 

a 12 

a 13 

1 6 l" 

a 21 

a 22 

a 23 

b 2 

_ a 31 

a 32 

a 33 

b 3 


First stage of elimination 


We assume a n =£ 0. This element a,, in the lxl position is called the first pivot. We use 
this pivot to reduce all the elements below this pivot in the first column as zeros. Multiply the 
first row in (1.39) by a 21 /a n an d a 31 /n n respectively and subtract from the second and third 
rows. That is, we are performing the elementary row operations R 2 - ( a 21 /a 11 )R 1 and 
R 3 -(.d 31 /a 11 )R 1 respectively. We obtain the new augmented matrix as 


“ll “l2 “l3 

bi ' 

n „(b „(b 

u “22 “23 

b§> 

n „(D 

u “32 “33 



where 

a ( 22 = a 22 - j 


|«!2 

,, a™ = a 23 - j 

L a n J 

| “i3> b™ = b 2 - ^ 


“32 = “32 “ | 

IS) 

“12 

, a { i = a 33 - 

K 



Second stage of elimination 


We assume a 22 * 0 . This element a 22 in the 2x2 position is called the second pivot. 
We use this pivot to reduce the element below this pivot in the second column as zero. Multi- 
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ply the second row in (1.40) by aS^/a^ and subtract from the third row. That is, we are 
performing the elementary row operation R 3 - ( a^ 32 / a 22 )^ 2 - We obtain the new augmented 
matrix as 


where 


°11 a 12 a 13 



(1.41) 


The element a ( 33 ^ 0 is called the third pivot. This system is in the required upper 
triangular form [U | z]. The solution vector x is now obtained by back substitution. 

From the third row, we get x 3 = b 3 2> /a ( ^ . 

From the second row, we get x 2 = (b { 2 ] - a 23 x 3 )la { 22 

From the first row, we get x 1 = (b 1 - a 12 x 2 - a 13 x 3 )/a u . 

In general, using a pivot, all the elements below that pivot in that column are made zeros. 

Alternately, at each stage of elimination, we may also make the pivot as 1, by dividing 
that particular row by the pivot. 

Remark 15 When does the Gauss elimination method as described above fail ? It fails when 
any one of the pivots is zero or it is a very small number, as the elimination progresses. If a 
pivot is zero, then division by it gives over flow error, since division by zero is not defined. If a 
pivot is a very small number, then division by it introduces large round-off errors and the 
solution may contain large errors. 

For example, we may have the system 
2x 2 + 5x 3 = 7 
7x 1 + x 2 - 2x 3 = 6 
2x 1 + 3x 2 + 8x 3 = 13 
in which the first pivot is zero. 

Pivoting Procedures How do we avoid computational errors in Gauss elimination ? To avoid 
computational errors, we follow the procedure of partial pivoting. In the first stage of 
elimination, the first column of the augmented matrix is searched for the largest element in 
magnitude and brought as the first pivot by interchanging the first row of the augmented 
matrix (first equation) with the row (equation) having the largest element in magnitude. In 
the second stage of elimination, the second column is searched for the largest element in 
magnitude among the n — 1 elements leaving the first element, and this element is brought as 
the second pivot by interchanging the second row of the augmented matrix with the later row 
having the largest element in magnitude. This procedure is continued until the upper triangular 
system is obtained. Therefore, partial pivoting is done after every stage of elimination. There 
is another procedure called complete pivoting. In this procedure, we search the entire matrix 
A in the augmented matrix for the largest element in magnitude and bring it as the first pivot. 
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This requires not only an interchange of the rows, but also an interchange of the positions of 
the variables. It is possible that the position of a variable is changed a number of times during 
this pivoting. We need to keep track of the positions of all the variables. Hence, the procedure 
is computationally expensive and is not used in any software. 

Remark 16 Gauss elimination method is a direct method. Therefore, it is possible to count 
the total number of operations, that is, additions, subtractions, divisions and multiplications. 
Without going into details, we mention that the total number of divisions and multiplications 
(division and multiplication take the same amount of computer time) is n (n 2 + 3 n- l)/3. The 
total number of additions and subtractions (addition and subtraction take the same amount of 
computer time) is n (n - 1)(2 n + 5)/6. 

Remark 17 When the system of algebraic equations is large, how do we conclude that it is 
consistent or not, using the Gauss elimination method ? A way of determining the consistency 
is from the form of the reduced system (1.41). We know that if the system is inconsistent then 
rank (A) =£ rank [A | b]. By checking the elements of the last rows, conclusion can be drawn 
about the consistency or inconsistency. 

Suppose that in (1.41), af 3 * 0 and b 3 2) * 0. Then, rank (A) = rank [A | b] = 3. The 
system is consistent and has a unique solution. 

Suppose that we obtain the reduced system as 


a ll a 12 a 13 

t>l' 

0 «22 a 23 

bg 3 

0 0 0 



Then, rank (A) = 2, rank [A | b] = 3 and rank (A) A rank [A | b]. Therefore, the system is 
inconsistent and has no solution. 

Suppose that we obtain the reduced system as 


a n 

a 12 

a 13 

1 &1 " 

0 

a 22 

a 23 

&2 U 

0 

0 

0 

o 


Then, rank (A) = rank [A|b] = 2 < 3. Therefore, the system has 3-2 = 1 parameter 
family of infinite number of solutions. 

Example 1.13 Solve the system of equations 
x 1 + 10x 2 - x 3 = 3 
2x ± + 3x 2 + 20x 3 = 7 
10x 1 -x 2 + 2x 3 = 4 

using the Gauss elimination with partial pivoting. 

Solution We have the augmented matrix as 


"1 

10 

-1 

1 3 

2 

3 

20 

7 

10 

-1 

2 

4 
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We perform the following elementary row transformations and do the eliminations. 
10 

2 3 

1 10 


-1 2 
3.2 19.6 

10.1 -1.2 | 


R, - (3.2/10.1 )R 2 


Back substitution gives the solution. 

5.37624 


2 

4' 




20 

7 

. R 2 - {RJ5), R 3 - (RJ 10) : 

-1 

3 




1 4 



"10 -1 

2 1 4 

6.2 


i?2 ^ -^3 • 

0 10.1 

-1.2 2.6 

2.6 



0 3.2 

19.6 6.2 

'10 

-1 

2 

4 


0 

10.1 -1.2 

2.6 


0 

0 

1 19.98020 | 5.37624 



Third equation gives 


' 19.98020 ' 
1 


Second equation gives x 0 = - (2.6 + 1.2x,) = - 

2 10.1 3 10.1 

First equation gives 


(2.6 + 1.2(0.26908)) = 0.28940. 


Xl = (4 + x 2 - 2x 3 ) = ^ (4 + 0.2894 - 2(0.26908)) = 0.37512. 


10 2 3 10 

Example 1.14 Solve the system of equations 
2x 4 +x 2 + x 3 - 2x 4 = - 10 
4x x + 2x 3 + x 4 = 8 
3 x x + 2x 2 + 2x 3 = 7 
x 1 + 3x 2 + 2x 3 - x 4 = - 5 

using the Gauss elimination with partial pivoting. 
Solution The augmented matrix is given by 


'2 11-2 

-10' 

4 0 2 1 

8 

3 2 2 0 

7 

13 2-1 

-5 


We perform the following elementary row transformations and do the eliminations. 


R 2 - (1/2) R v R 3 - (3/4) R v R 4 - (1/4) R 4 . 


'4 0 2 1 

8 ' 

2 11-2 

-10 

3 2 2 0 

7 

13 2-1 

-5 
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4 0 2 1 

0 1 0 -5/2 

0 2 1/2 -3/4 
0 3 3/2 -5/4 


R 3 - (2/3) R 2 , R 4 - (1/3 )R 2 : 


'4 0 2 1 

0 3 3/2 -5/4 

0 0 -1/2 1/12 

0 0 0 -13/6 


Using back substitution, we obtain 



"4 0 2 

1 


*2 -R 4 * 

0 3 3/2 

-5/4 



0 2 1/2 

-3/4 



0 10 

-5/2 


"4 0 ! 

2 1 

8 


0 3 3/2 - 5/4 

-7 


0 0 - 1/2 1/12 

17/3 


0 0 -1/2 -25/12 

- 35/3 

8 




-7 




17/3 




-52/3 





R 4 -R 3 


-?B— 




i[- 7 -(I>3 + (!>‘]4[- 7 -(I) < - 10,+ (!) <8> ]= 6 - 

*, = -[8-2x 3 -xA = — [8 - 2(- 10) - 8] = 5. 

4 4 

Example 1.15 Solve the system of equations 

3x 1 + 3x 2 + 4x 3 = 20 

2x x + x 2 + 3x 3 = 13 

x 4 + x 2 + 3x 3 = 6 

using the Gauss elimination method. 

Solution Let us solve this problem by making the pivots as 1. The augmented matrix is given 
by 


"3 3 41 20" 

2 1 3 13 ■ 

1 1 3 | 6 

We perform the following elementary row transformations and do the eliminations. 


"1 

1 

4/3 

20/3" 


"1 

1 4/3 20/3" 

2 

1 

3 

13 

. R 2 — 2/? i , R 3 — Ry 

0 

-1 1/3 -1/3 

1 

1 

3 

6 


0 

0 5/3 - 2/3 
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Back substitution gives the solution as 


= f2Y3^ = _2 l + ^ = l + lf 2\ 

UJUJ 5 2 3 3 3 3 V 5 J 


20 

4 20 1 4f 2") 

35 

3 

3* 3 3 5 3 Y 5 J 

5 


1 

5 ’ 


Example 1.16 Test the consistency of the following system of equations 
x x + 10x 2 - x 3 = 3 
2x 1 + 3 x 2 + 20x 3 = 7 
9x 1 + 22x 2 + 79x 3 = 45 
using the Gauss elimination method. 

Solution We have the augmented matrix as 


1 

10 

-l 

3' 

2 

3 

20 

7 

9 

22 

79 

45 


We perform the following elementary row transformations and do the eliminations. 



"1 

10 

-1 

1 3 


"1 

10 

-1 

1 3 " 

i? 2 — 2 Rp R 3 — 9i? 1 : 

0 

-17 

22 

1 

. R 3 - 4R 2 : 

0 

-17 

22 

1 


0 

-68 

88 

18 


0 

0 

0 

14 


Now, rank [A] = 2, and rank [A | b] = 3. Therefore, the system is inconsistent and has no 
solution. 


1.2.2.2 Gauss-Jordan Method 

The method is based on the idea of reducing the given system of equations Ax = b, to a 
diagonal system of equations lx = d, where I is the identity matrix, using elementary row 
operations. We know that the solutions of both the systems are identical. This reduced system 
gives the solution vector x. This reduction is equivalent to finding the solution as x = A -1 b. 


Gauss-Jordan method 

[A | b] --—--> II | X] 

In this case, after the eliminations are completed, we obtain the augmented matrix for 
a 3 x 3 system as 


1 

0 

0 

d{ 

0 

1 

0 

d,2 

0 

0 

1 

d 3 


and the solution is 


x t = d t ,i = 1, 2, 3. 
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Elimination procedure The first step is same as in Gauss elimination method, that is, we 
make the elements below the first pivot as zeros, using the elementary row transformations. 
From the second step onwards, we make the elements below and above the pivots as zeros 
using the elementary row transformations. Lastly, we divide each row by its pivot so that the 
final augmented matrix is of the form (1.42). Partial pivoting can also be used in the solution. 
We may also make the pivots as 1 before performing the elimination. 

Let us illustrate the method. 

Example 1.17 Solve the following system of equations 
x x + x 2 + x 3 = 1 
4x 1 + 3 x 2 - x 3 = 6 
3x 1 + 5x 2 + 3x 3 = 4 

using the Gauss-Jordan method (i) without partial pivoting, (ii) with partial pivoting. 
Solution We have the augmented matrix as 

"11 111 ' 

4 3 -16 
3 5 3 | 4 

(i) We perform the following elementary row transformations and do the eliminations. 


- 4 R v R 3 - 3R 1 : 


R ^ + R 2 , R$ + 2Z?2 • 


R x - (4/10 )R 3 , R 2 - (5/10) R 3 : 

Now, making the pivots as 1, ((- R 2 ), (R.f(- 10))) we get 



"111 

r 


0-1-5 

2 


0 2 0 

i 


L 0 -4 

3' 

0 -1 -5 

2 

0 0-10 

5 


1 0 

0 -1 
0 0 


1 

0 

0 

1 

0 

1 

0 

1/2 

0 

0 

1 

- 1/2 


Therefore, the solution of the system is x x = 1, x 2 = 1/2, x 3 = - 1/2. 

(ii) We perform the following elementary row transformations and do the elimination. 



'43-1 

6' 


"1 3/4 -1/4 1 

3/2' 

Ri • 

11 1 

3 5 3 

1 

4 

. Rjf 4 : 

11 1 

3 5 3 

1 

4 
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1 

3/4 

-1/4 1 

3/2 ' 

0 

1/4 

5/4 

-1/2 

0 

11/4 

15/4 

-1/2 


1 

3/4 

-1/4 

3/2 ' 


1 

3/4 

-1/4 

3/2 ' 

0 

11/4 

15/4 

-1/2 

. R 2 /(ll/4) : 

0 

1 

15/11 

-2/11 

0 

1/4 

5/4 

-1/2 

0 

1/4 

5/4 

-1/2 



"1 0 -14/11 

18/11" 

R 1 - (3/4) R 2 , R 3 - (1/4 )R 2 : 

0 1 15/11 
0 0 10/11 

-2/11 
- 5/11 



"10- 14/11 

18/11" 

R 3 /( 10/11) : 

0 1 15/11 

0 0 1 

-2/11 

-1/2 



"10 0 

1 

R 1 + (14/11) R 3 , R 2 - (15/lDRg : 

0 10 

0 0 1 

1/2 

-1/2 


Therefore, the solution of the system is x 1 = 1, x 2 = 1/2, x 3 = - 1/2. 

Remark 18 The Gauss-Jordan method looks very elegant as the solution is obtained directly. 
However, it is computationally more expensive than Gauss elimination. For large n, the total 
number of divisions and multiplications for Gauss-Jordan method is almost 1.5 times the 
total number of divisions and multiplications required for Gauss elimination. Hence, we do 
not normally use this method for the solution of the system of equations. The most important 
application of this method is to find the inverse of a non-singular matrix. We present this 
method in the following section. 


1.2.2.3 Inverse of a Matrix by Gauss-Jordan Method 

As given in Remark 18, the important application of the Gauss-Jordan method is to 
find the inverse of a non-singular matrix A. We start with the augmented matrix of A with the 
identity matrix I of the same order. When the Gauss-Jordan procedure is completed, we ob¬ 
tain 

Gauss-Jordan method 

[A | I] -» [I | A' 1 ] 

since, AA -1 = I. 

Remark 19 Partial pivoting can also be done using the augmented matrix [A 1 1] . However, 
we cannot first interchange the rows of A and then find the inverse. Then, we would be finding 
the inverse of a different matrix. 

Example 1.18 Find the inverse of the matrix 


"1 1 1 ' 
4 3-1 
3 5 3 
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using the Gauss-Jordan method (i) without partial pivoting, and (ii) with partial pivoting. 
Solution Consider the augmented matrix 


1 

1 

1 1 

0 

O' 

4 

3 

-1 0 

1 

0 

3 

5 

3 0 

0 

1 


{i) We perform the following elementary row transformations and do the eliminations. 


R 2 - 4 R v R 3 - 3 Ry 


"1 

1 

1 

1 

0 

O' 

0 

-1 

-5 

-4 

1 

0 

0 

2 

o 

-3 

0 

1 


1 1 

1 

o 

O 




1 5 ‘ 

4 - 

-1 0 




2 0 - 

3 

0 1 





'1 0 -4 

I - 3 1 O' 



3 - 2R 2 : 

0 

1 5 

4-10 




0 0 - 10 1 - 11 2 1 



1 0 

-4 

-3 

1 0 



0 1 

5 

4 

-1 0 



0 0 

1 

11/10 

- 2/10 - 1/10 



"1 

0 0 

14/10 2/10 

- 4/10' 

\ 2 - 5R 3 : 

0 

1 0 

-15/10 0 


5/10 


0 

0 1 

11/10 - 2/10 

-1/10 


Therefore, the inverse of the given matrix is given by 


' 7/5 1/5 -2/5' 

- 3/2 0 1/2 

11/10 -1/5 -1/10 ' 


(ii) We perform the following elementary row transformations and do the eliminations. 


'4 

3 

- i 

0 

1 

o' 


1 

3/4 

-1/4 

0 

1/4 

O' 

1 

1 

1 

1 

0 

0 

. R 1 /4: 

1 

1 

1 

1 

0 

0 

3 

5 

3 

0 

0 

1 


3 

5 

3 

o 

0 

1 


R 2 - R v R 3 - 3 R 1 


1 

3/4 

-1/4 

0 1/4 

O' 

0 

1/4 

5/4 

1-1/4 

0 

0 

11/4 

15/4 

0 -3/4 

1 


1 

3/4 

-1/4 

1 0 

1/4 

O' 

0 

11/4 

15/4 

0 

-3/4 

1 

0 

1/4 

5/4 

1 

-1/4 

0 
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"1 3/4 

-1/4 


0 

1/4 

0 



i? 2 /(ll/4) : 

0 1 

15/11 

0 

- 3/11 

4/11 



0 1/4 

5/4 


1 

-1/4 

0 






'1 

0 

-14/11 

1 0 

5/11 

- 3/11 

R , - (3/4) R 2 , R, - 

(1/4)J? 2 : 

0 

1 

15/11 

0 

- 3/11 

4/11 




0 

0 

10/11 

1 

- 2/11 

-1/11 


1 0 

-14/11 1 

0 

5/11 

- 3/11 



0 1 

15/11 

0 

-3T1 

4/11 



0 0 

1 | 11/10 

-1/5 

-1/10 





1 

0 0 1 

7/5 

1/5 

-2/5 ' 

r 3 ,r 2 

- (15/ll)/?3 : 

0 

1 0 

-3/2 

0 

1/2 



0 

0 1 

mo -1/5 

-1/10 


Therefore, the inverse of the matrix is given by 


7/5 1/5 

-3/2 0 

11/10 -1/5 


Example 1.19 Using the Gauss-Jordan method, find the inverse of 

2 2 3 
2 11 
1 3 5 

Solution We have the following augmented matrix. 


(A.U. Apr./May 2004) 


'2 2 3 11 0 O' 

2 110 10 

1 3 5 | 0 0 1 


We perform the following elementary row transformations and do the eliminations. 



1 1 3/2 

1/2 0 O' 


"1 1 

3/2 1 

1/2 0 O' 

E/2 : 

2 11 

13 5 

0 10 

0 0 1 

. i? 2 — 2/2.p i?3 — : 

0 -1 

0 2 

-2 

7/2 

-110 
-1/2 0 1 



1 

1 

3/2 1 

1/2 

0 

0 ' 

R 2 i? 3 . Then, : 

0 

1 

7/4 

-1/4 

0 

1/2 


0 

-1 

-2 

-1 

1 

0 


1 

0 

-1/4 1 

3/4 

0 

-1/2 

0 

1 

7/4 

-1/4 

0 

1/2 

0 

0 

-1/4 

-5/4 

1 

1/2 
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"1 

0 

-1/4 

3/4 

0 

-1/2' 



- 1/4) : 

0 

1 

7/4 

-1/4 

0 

1/2 




0 

0 

1 

5 

-4 

-2 







"1 0 

0 

2 

-1 

-l" 

■ (l/4)i? 3 , R 2 

- (7/4)J?o : 

0 1 

0 

-9 

7 

4 





0 0 

1 

5 

-4 

-2 


Therefore, the inverse of the given matrix is given by 

"2 -1 -T 

-9 7 4- 

5 -4 -2 

- f REVIEW QUESTIONS "j - 

1. What is a direct method for solving a linear system of algebraic equations Ax = b ? 
Solution Direct methods produce the solutions in a finite number of steps. The number 
of operations, called the operational count, can be calculated. 

2. What is an augmented matrix of the system of algebraic equations Ax = b ? 

Solution The augmented matrix is denoted by [A | b], where A and b are the coeffi¬ 
cient matrix and right hand side vector respectively. If A is an n x n matrix and b is an 
fix 1 vector, then the augmented matrix is of order n x (n + 1). 

3. Define the rank of a matrix. 

Solution The number of linearly independent rows/columns of a matrix define the row- 
rank/column-rank of that matrix. We note that row-rank = column-rank = rank. 

4. Define consistency and inconsistency of a system of linear system of algebraic equa¬ 
tions Ax = b. 

Solution Let the augmented matrix of the system be [A | b]. 

( i ) The system of equations Ax = b is consistent (has at least one solution), if 

rank (A) = rank [A | b] = r. 

If r = n, then the system has unique solution. 

If r <n, then the system has in — r ) parameter family of infinite number of solutions. 

(ii) The system of equations Ax = b is inconsistent (has no solution) if 

rank (A) =£ rank [A | b], 

5. Define elementary row transformations. 

Solution We define the following operations as elementary row transformations. 

( i ) Interchange of any two rows. If we interchange the ith row with the jth row, then we 
usually denote the operation as R L 22.. 

(ii) Division/multiplication of any row by a non-zero number p. If the ith row is multi¬ 
plied by p, then we usually denote this operation as pR t . 
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( Hi ) Adding/subtracting a scalar multiple of any row to any other row. If all the elements 
of the j'th row are multiplied by a scalar p and added to the corresponding elements 
of the ith row, then, we usually denote this operation as R t R ■ + pRj. Note the 
order in which the operation R { + pR is written. The elements of the j'th row remain 
unchanged and the elements of the ith row get changed. 

6. Which direct methods do we use for ( i ) solving the system of equations Ax = b, and ( ii ) 
finding the inverse of a square matrix A? 

Solution (i) Gauss elimination method and Gauss-Jordan method, (ii) Gauss-Jordan 
method. 

7. Describe the principle involved in the Gauss elimination method. 

Solution The method is based on the idea of reducing the given system of equations Ax 
= b, to an upper triangular system of equations Ux = z, using elementary row opera¬ 
tions. We know that these two systems are equivalent. That is, the solutions of both the 
systems are identical. This reduced system Ux = z, is then solved by the back substitu¬ 
tion method to obtain the solution vector x. 

8. When does the Gauss elimination method fail? 

Solution Gauss elimination method fails when any one of the pivots is zero or it is a 
very small number, as the elimination progresses. If a pivot is zero, then division by it 
gives over flow error, since division by zero is not defined. If a pivot is a very small 
number, then division by it introduces large round off errors and the solution may con¬ 
tain large errors. 

9. How do we avoid computational errors in Gauss elimination? 

Solution To avoid computational errors, we follow the procedure of partial pivoting. In 
the first stage of elimination, the first column of the augmented matrix is searched for 
the largest element in magnitude and brought as the first pivot by interchanging the 
first row of the augmented matrix (first equation) with the row (equation) having the 
largest element in magnitude. In the second stage of elimination, the second column is 
searched for the largest element in magnitude among the n - 1 elements leaving the 
first element, and this element is brought as the second pivot by interchanging the 
second row of the augmented matrix with the later row having the largest element in 
magnitude. This procedure is continued until the upper triangular system is obtained. 
Therefore, partial pivoting is done after every stage of elimination. 

10. Define complete pivoting in Gauss elimination. 

Solution In this procedure, we search the entire matrix A in the augmented matrix for 
the largest element in magnitude and bring it as the first pivot. This requires not only 
an interchange of the equations, but also an interchange of the positions of the vari¬ 
ables. It is possible that the position of a variable is changed a number of times during 
this pivoting. We need to keep track of the positions of all the variables. Hence, the 
procedure is computationally expensive and is not used in any software. 

11. Describe the principle involved in the Gauss-Jordan method for finding the inverse of a 
square matrix A. 
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Solution We start with the augmented matrix of A with the identity matrix I of the 
same order. When the Gauss-Jordan elimination procedure using elementary row trans¬ 
formations is completed, we obtain 

Gauss-Jordan method 

[A | I]-> [I | A' 1 ] 

since, AA -1 = I. 

12 . Can we use partial pivoting in Gauss-Jordan method? 

Solution Yes. Partial pivoting can also be done using the augmented matrix [A | I], 
However, we cannot first interchange the rows of A and then find the inverse. Then, we 
would be finding the inverse of a different matrix. 


EXERCISE 1 


Solve the following system of equations by Gauss elimination method. 


ID- 


10* - 2y + 3z = 23 
2* + lOy - 5z = - 53 
3* - 4 y + 10 z = 33. 


2 . 3.15* - 1.96y + 3.852 = 12.95 
2.13* + 5.12y - 2.892 = - 8.61 
5.92* + 3.05y + 2.152 = 6.88. 


2 2 1 
4 3 3 

111 


'2 112' 

*1 


2' 

4 0 2 1 

* 2 


3 

3 2 2 0 

*3 


-1 

13 2 6 

_*4_ 


2 


Solve the following system of equations by Gauss-Jordan method. 

5. 10* + y + 2 = 12 
2* + lOy + 2 = 13 

* + y + 52 = 7. 

6. * + 3y + 32 = 16 

* + 4y + 32 = 18 

* + 3y + 42 = 19. 

7 . 10* - 2y + 32 = 23 8 . * 1 +* 2 + * 3 = l 

2* + lOy - 52 = - 53 4* 1 + 3* 2 - * 3 = 6 

3* - 4y + 102 = 33. 3* x + 5* 2 + 3* 3 = 4. 

Find the inverses of the following matrices by Gauss-Jordan method. 


( A.U. Nov /Dec 2004) 


(A.U. Apr /May 2005) 


9 . 


11 . 


[ 2 1 1 ] 

3 2 3 . A.U. Nov/Dec 2006) 

Ll 4 9 J 

"2 2 6 ' 

2 6 -6 . 

4 -8 -8 



'2 0 1 

3 2 5 

1-10 


(A.E7. Nov/Dec 2006) 


(A.U. Nov /Dec 2005) 
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Show that the following systems of equations are inconsistent using the Gauss elimination 
method. 

13. 2x 1 + x 2 - 3x 3 = 0 14. x x -3x 2 + 4x 3 = 2 

5x x + 8x 2 + x 3 = 14, x 1 + x 2 - x 3 = 0 

4x 1 + 13 x 2 + llx 3 = 25. 3x 1 - x 2 + 2x 3 = 4. 

Show that the following systems of equations have infinite number of solutions using the Gauss 
elimination. 

15. 2x t + x 2 - 3x 3 = 0, 16. + 5x 2 - x 3 = 0, 

5a: 1 + 8x 2 + x 3 = 14, 2x x + 3x 2 + x 3 = 11, 

4x x + 13a: 2 + 11 k 3 = 28. 5x x + llx 2 + x 3 = 22. 

1.2.3 Iterative Methods 

As discussed earlier, iterative methods are based on the idea of successive approximations. 
We start with an initial approximation to the solution vector x = x 0 , to solve the system of 
equations Ax = b, and obtain a sequence of approximate vectors x 0 , x p ..., x k , ..., which in the 
limit as k -» °°, converges to the exact solution vector x = A _1 b. A general linear iterative 
method for the solution of the system of equations Ax = b, can be written in matrix form as 
xtt+U _ Hx® + c, k = 0, 1, 2, ... (1.43) 

where x (A+1) and x (k> are the approximations for x at the (k + l)th and kth iterations respec¬ 
tively. H is called the iteration matrix, which depends on A and c is a column vector, which 
depends on A and b. 

When to stop the iteration We stop the iteration procedure when the magnitudes of the 
differences between the two successive iterates of all the variables are smaller than a given 
accuracy or error tolerance or an error bound e, that is, 

| x\ k + 1} - x\ k) | < e, for all i. (1.44) 

For example, if we require two decimal places of accuracy, then we iterate until 
x ^ +1) - x\ k) < 0.005, for all i. If we require three decimal places of accuracy, then we iterate 
until | x\ k +1} - x\ k) | < 0.0005, for all i. 

Convergence property of an iterative method depends on the iteration matrix H. 

Now, we derive two iterative methods for the solution of the system of algebraic equations 
°11*1 + °12*2 + “13*3 = b l 

a 2l x l + a 2 ^ic 2 + a 2 ^ic 3 = b 2 (1.45) 

a 31 X l + “32^2 + = b 3 

1.2.3.1 Gauss-Jacobi Iteration Method 

Sometimes, the method is called Jacobi method. We assume that the pivots a u 0, for 
all i. Write the equations as 
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“ll^l = &i - («12^2 + “13*3) 

«22 x 2 = 6 2 - ( a 21 X l + a 23 X 3 ) 

°33*3 = 6 3 - (°31*1 + a 32^ 2 ) 

The Jacobi iteration method is defined as 

x (k + i) = J_ [6i _ (a 12 x® + a 13 x^)] 

a il 

x 2* +1) = ~ [^2 ~~ ( a 21 X l^ + 023*8*^1 

x (k +1) = J_ [&3 _ (a uX (k) + a 32X «>)] k = 0,l,2,... (1.46) 

a 33 

Since, we replace the complete vector x® in the right hand side of (1.46) at the end of 
each iteration, this method is also called the method of simultaneous displacement. 

Remark 20 A sufficient condition for convergence of the Jacobi method is that the system of 
equations is diagonally dominant, that is, the coefficient matrix A is diagonally dominant. We 

can verify that | a u \ > ^ | ay \. This implies that convergence may be obtained even if the 

system is not diagonally dominant. If the system is not diagonally dominant, we may exchange 
the equations, if possible, such that the new system is diagonally dominant and convergence 
is guaranteed. However, such manual verification or exchange of equations may not be possible 
for large systems that we obtain in application problems. The necessary and sufficient condition 
for convergence is that the spectral radius of the iteration matrix H is less than one unit, that 
is, p(H) < 1, where p(H) is the largest eigen value in magnitude of H. Testing of this condition 
is beyond the scope of the syllabus. 

Remark 21 How do we find the initial approximations to start the iteration ? If the system is 
diagonally dominant, then the iteration converges for any initial solution vector. If no suitable 
approximation is available, we can choose x = 0, that is x t = 0 for all i. Then, the initial 
approximation becomes x t = b./a u , for all i. 

Example 1.20 Solve the system of equations 
Ax x + x 2 + x 3 = 2 
x 1 + 5x 2 + 2x 3 = - 6 
x 1 + 2x 2 + 3x 3 = - 4 

using the Jacobi iteration method. Use the initial approximations as 

C i ) x t = 0,i = l, 2, 3, (ii) x 1 = 0.5, x 2 = - 0.5, x 3 = - 0.5. 

Perform five iterations in each case. 

Solution Note that the given system is diagonally dominant. Jacobi method gives the iterations 
as 

x^ k+1) = 0.25 [2 - (x 2 <k) + x 3 ®)] 
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x 2 <* + ® = 0.2 [- 6 - (x/* 0 + 2x 3 ®)] 

x 3 ( * + ® = 0.33333 [- 4 - (x/*> + 2x 2 ®)], & = 0, 1, ... 

We have the following results. 

(i) x/ 0) = 0, x 2 (0) = 0, x 3 (0) = 0. 

Mrst iteration 

x/® = 0.25 [2 - (x 2 (0) + x 3 (0) )] = 0.5, 

x 2 ( ® = 0.2 [- 6 - (x a (0) + 2 x 3 (0) )] = - 1.2, 

x 3 (1) = 0.33333 [- 4 - (x/ 0) + 2x 2 (0) )] = - 1.33333. 

Second iteration 

x/ 2 > = 0.25 [2 - (x 2 (1) + x 3 (1) )] = 0.25 [2 - (- 1.2 - 1.33333)] = 1.13333, 
x 2 (2) = 0.2 [- 6 - Or/® + 2 x 3 (1) )] = 0.2 [- 6 - (0.5 + 2(- 1.33333))] = - 0.76668, 
x 3 (2) = 0.33333 [- 4 - (x/® + 2x 2 ( ®)] = 0.33333 [- 4 - (0.5 + 2(- 1.2))] = - 0.7. 

Third iteration 

x/ 3) = 0.25 [2 - (x 2 (2) + x 3 (2) )] = 0.25 [2 - (- 0.76668 - 0.7)] = 0.86667, 
x 2 (3) = 0.2 [- 6 - (x/ 2) + 2 x 3 (2) )] = 0.2 [- 6 - (1.13333 + 2(- 0.7))] = - 1.14667, 
x 3 (3) = 0.33333 [- 4 - (x/ 2) + 2x/ 2 >)] 

= 0.33333 [- 4 - (1.13333 + 2(- 0.76668))] = - 1.19998. 

Fourth iteration 

x/ 4 > = 0.25 [2 - (x 2 (3) + x 3 (3) )] = 0.25 [2 - (- 1.14667 - 1.19999)] = 1.08666, 
x 2 (4) = 0.2 [- 6 - (x/ 3) + 2 x 3 (3) )] = 0.2 [- 6 - (0.86667 + 2(- 1.19998))] = - 0.89334, 
x 3 (4) = 0.33333 [- 4 - (x/ 3) + 2x 2 (3) )] 

= 0.33333 [- 4 - (0.86667 + 2(- 1.14667))] = - 0.85777. 

Fifth iteration 

x/ 5) = 0.25 [2 - (x 2 (4) + x 3 (4) )] = 0.25 [2 - (- 0.89334 - 0.85777)] = 0.93778, 
x 2 ® = 0.2 [- 6 - (x/ 4) + 2 x 3 (4) )] = 0.2 [- 6 - (1.08666 + 2(- 0.85777))] = - 1.07422, 
x 3 ® = 0.33333 [-4- (x/ 4) + 2x 2 (4) )] 

= 0.33333 [- 4 - (1.08666 + 2(- 0.89334))] = - 1.09998. 

It is interesting to note that the iterations oscillate and converge to the exact solution 
x x = 1.0, x 2 = — 1, x 3 = — 1.0. 

Hi) x/ 0) = 0.5, x 2 (0) = - 0.5, x 3 (0) = - 0.5. 

First iteration 

x/® = 0.25 [2 - (x 2 (0) + x 3 (0) )] = 0.25 [2 - (- 0.5 - 0.5)] = 0.75, 

x 2 ( ® = 0.2 [- 6 - (x/ 0) + 2 x 3 (0) )] = 0.2 [- 6 - (0.5 + 2(- 0.5))] = - 1.1, 

x 3 ( ® = 0.33333 [- 4 - (x/ 0) + 2x 2 (0) )] = 0.33333 [- 4 - (0.5 + 2(- 0.5))] = - 1.16667. 
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Second iteration 

x x < 2 > = 0.25 [2 - (x 2 (1) + x 3 (1) )] = 0.25 [2 — (— 1.1 — 1.16667)] = 1.06667, 
x 2 (2) = 0.2 [- 6 - (x x (1) + 2x 3 (1) )] = 0.2 [- 6 - (0.75 + 2(- 1.16667))] = - 0.88333, 
x 3 (2) = 0.33333 [- 4 - (x x (1) + 2x 2 (1) )] = 0.33333 [- 4 - (0.75 + 2(- 1.1))] = - 0.84999. 
Third iteration 

x x (3) = 0.25 [2 - (x 2 (2) + x 3 <®)] = 0.25 [2 - (- 0.88333 - 0.84999)] = 0.93333, 
x 2 (3) = 0.2 [- 6 - (x x (2) + 2 x 3 (2) )] = 0.2 [- 6 - (1.06667 + 2(- 0.84999))] = - 1.07334, 
x 3 (3) = 0.33333 [- 4 - (x/ 2) + 2x 2 (2) )] 

= 0.33333 [- 4 - (1.06667 + 2(- 0.88333))] = - 1.09999. 

Fourth iteration 

x x (4) = 0.25 [2 - (x 2 (3) + x 3 (3) )] = 0.25 [2 - (- 1.07334 - 1.09999)] = 1.04333, 
x 2 (4) = 0.2 [- 6 - (x x (3) + 2 x 3 (3) )] = 0.2 [- 6 - (0.93333 + 2(- 1.09999))] = - 0.94667, 
x 3 (4) = 0.33333 [-4- (x x (3) + 2* 2 ®)] 

= 0.33333 [- 4 - (0.93333 + 2(- 1.07334))] = - 0.92887. 

Fifth iteration 

x x (5) = 0.25 [2 - (x 2 (4) + x 3 (4) )] = 0.25 [2 - (- 0.94667 - 0.92887)] = 0.96889, 
x 2 ® = 0.2 [- 6 - (x x (4) + 2 x 3 (4) )] = 0.2 [- 6 - (1.04333 + 2(- 0.92887))] = - 1.03712, 
x 3 ® = 0.33333 [- 4 - (x x (4) + 2x 2 (4) )] 

= 0.33333 [- 4 - (1.04333 + 2(- 0.94667))] = - 1.04999. 

Example 1.21 Solve the system of equations 
26x x + 2 x 2 + 2x 3 = 12.6 
3x x + 27 x 2 + x 3 = - 14.3 
2x x + 3 x 2 + 17x 3 = 6.0 

using the Jacobi iteration method. Obtain the result correct to three decimal places. 

Solution The given system of equations is strongly diagonally dominant. Hence, we can ex¬ 
pect faster convergence. Jacobi method gives the iterations as 
x x ( * +1) = [12.6 - (2* a ® + 2x ; ®)]/26 
xf k+1) = [- 14.3 - (3x x ( « + x 3 ®)]/27 
x 3 ( * +1) = [6.0 - (2x x (W + 3 x 2 ®)]/17 k = 0,l, ... 

Choose the initial approximation as = 0, x 2 ( ® = 0, x 3 (0) = 0. We obtain the following 
results. 

First iteration 

x« = ^ [12.6 - (2x 2 (0) + 2x 3 (0) )] = ^ [12.6] = 0.48462, 
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x® = ^ [- 14.3 - (a*!® + x 3 (0) )] = i 'it- 14.3] = - 0.52963, 

x 3 (1) = ~ [6.0 - (2x/°> + 3x 2 (0) )] = i [6.0] = 0.35294. 

Second iteration 

oc™ = ^ [12.6 - (2x 2 (1) + 2x 3 (1) )] = ^ [12.6 - 2 (- 0.52963 + 0.35294)] = 0.49821, 

x 9 (2) = — [- 14.3 - (3x. (1) + x 3 (1) )] = [- 14.3 - (3(0.48462) + 0.35294)] = - 0.59655, 

2 27 1 3 27 

Xg (2) = • *-. f- 6.0 - (2x x (1) + 3x 2 (1) )] = ~ [6.0 - (2(0.48462) + 3(- 0.52963))] = 0.38939. 
Third iteration 

oc® = ^ [12.6 - (2x 2 (2) + 2x 3 (2) )] = ^ [12.6 - 2(- 0.59655 + 0.38939)] = 0.50006, 

x 2 (3) = [- 14.3 - (3x 1 (2) + x 3 ®)] = ^ [- 14.3 - (3(0.49821) + 0.38939)] = - 0.59941, 

x 3 (3) = * t- 6.0 - (2*.® + 3x 2 (2) )] = i [6.0 - (2(0.49821) + 3(- 0.59655))] = 0.39960. 
Fourth iteration 

x x (4) = ^ [12 ‘ 6 “ (2X 2 3) + = ^6 [12 ‘ 6 “ 2(_ 0,59941 + °- 3996 °)] = 0.50000, 

x 2 (4) = ^ [- 14.3 - (Sx^® + x 3 ®)] = i i|- 14.3 - (3(0.50006) + 0.39960)] = - 0.59999, 
x 3 (4) = i [- 6.0 - (2X-,® + 3x 2 (3) )] = ~ [6.0 - (2(0.50006) + 3(- 0.59941))] = 0.39989. 
We find | x^ 4) -4 3) | = | 0.5 - 0.50006 | = 0.00006, 

x 2 4) ~ x 2 3) = I - 0.59999 + 0.59941 | = 0.00058, 
x' 4) -x< 3) = | 0.39989 - 0.39960 | = 0.00029. 

Three decimal places of accuracy have not been obtained at this iteration. 

Fifth iteration 

X 1 ® = ^ [12.6 - (2x 2 (4) + 2x 3 (4) )] = ^ [12.6 - 2(- 0.59999 + 0.39989)] = 0.50001, 
x 2 (6) = 1 [- 14.3 - (3x 1 (4) + x 3 (4) )] = [- 14.3 - (3(0.50000) + 0.39989)] = - 0.60000, 
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x 3 ® = [- 6.0 - (2x x (4) + 3x 2 (4) )] = i [6.0 - (2(0.50000) + 3(- 0.59999))] = 0.40000. 


We find | x{ 4) -^i 3) | = I 0.50001 - 0.5 | = 0.00001, 

4 4> -4 3> = I - 0.6 + 0.59999 | = 0.00001, 

4 4) -^s 3) = I 0.4 - 0.39989 | = 0.00011. 

Since, all the errors in magnitude are less than 0.0005, the required solution is 
x 1 = 0.5, x 2 = - 0.6, x 3 = 0.4. 

Remark 22 What is the disadvantage of the Gauss-Jacobi method ? At any iteration step, the 
value of the first variable x 1 is obtained using the values of the previous iteration. The value of 
the second variable x 2 is also obtained using the values of the previous iteration, even though 
the updated value of x 1 is available. In general, at every stage in the iteration, values of the 
previous iteration are used even though the updated values of the previous variables are 
available. If we use the updated values of x v x 2 ,..., x t l in computing the value of the variable 
x jt then we obtain a new method called Gauss-Seidel iteration method. 

1.2.3.2 Gauss-Seidel Iteration Method 

As pointed out in Remark 22, we use the updated values of x v x 2 ,..., x t l in computing 
the value of the variable x-. We assume that the pivots a u ^ 0, for all i. We write the equations 
as 


a u Xi = b 1 - (a 12 x 2 + a 13 x 3 ) 
a 22 x 2 -b 2 - (a 21 x 1 + a 23 x 3 ) 
“ss*3 = b 3 ~ Ki x i + a 32* 2 ) 


The Gauss-Seidel iteration method is defined as 


x/^i) = — [b 1 - (a 12 x 2 ® + a 13 x 3 ®)] 
a n 


xf k+1) = [b 2 - (a 21 x 1 ( * +1) + a 23 x 3 ®)] 


x 3 ( * + D = — [b 3 - (a ?A xf k+1) + a 32 x 2 « +1) )] 
a 33 

k = 0 , 1 , 2 ,... 


(1.47) 


This method is also called the method of successive displacement. 
We observe that (1.47) is same as writing the given system as 



= b 1 - (a 12 xf k) + a 13 x 3 ®) 
= b 2~ °23 X 3~ k) 


(1.48) 



SOLUTION OF EQUATIONS AND EIGEN VALUE PROBLEMS 


47 


Remark 23 A sufficient condition for convergence of the Gauss-Seidel method is that the sys¬ 
tem of equations is diagonally dominant, that is, the coefficient matrix A is diagonally domi¬ 
nant. This implies that convergence may be obtained even if the system is not diagonally 
dominant. If the system is not diagonally dominant, we may exchange the equations, if possi¬ 
ble, such that the new system is diagonally dominant and convergence is guaranteed. The 
necessary and sufficient condition for convergence is that the spectral radius of the iteration 
matrix H is less than one unit, that is, p(H) < 1, where p(H) is the largest eigen value in 
magnitude of H. Testing of this condition is beyond the scope of the syllabus. 

If both the Gauss-Jacobi and Gauss-Seidel methods converge, then Gauss-Seidel method 
converges at least two times faster than the Gauss-Jacobi method. 

Example 1.22 Find the solution of the system of equations 


45x 1 + 2x 2 + 3x 3 = 58 
- 3x x + 22£ 2 + 2 x 3 = 47 
5x t + x 2 + 20x 3 = 67 


correct to three decimal places, using the Gauss-Seidel iteration method. 

Solution The given system of equations is strongly diagonally dominant. Hence, we can expect 
fast convergence. Gauss-Seidel method gives the iteration 



Starting with x 1 (0) = 0, x 2 (0) = 0, x 3 (0) = 0, we get the following results. 
First iteration 


x® = (58 - 2x ® - 3x, (0) ) = \ (58) = 1.28889, 

1 45 z 15 45 

x 2 ® = ^ (47 + 3x 1 (1) - 2x 3 (0) ) = ^ (47 + 3(1.28889) - 2(0)) = 2.31212, 
x® = ^ (67 - 5x™ - x®) = ^ (67 - 5(1.28889) - (2.31212)) = 2.91217. 


Second iteration 


x® = — (58 - 2x ® - 3x ®) = 

i 45 z a 

x 2 ® = ~ (47 + 3x/ 2) - 2x 3 ®) = 


(58 - 2(2.31212) - 3(2.91217)) = 0.99198, 


22 


(47 + 3(0.99198) - 2(2.91217)) = 2.00689, 
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x,® = ^ (67 - 5*!®-x 2 (2) ) = ^ (67 - 5(0.99198) - (2.00689)) = 3.00166. 

Third iteration 

x® = (58 - 2x< 2) - 3x,®) = — (58 - 2(2.00689) - 3(3.00166) = 0.99958, 

1 45 2 d 45 

x 2 ® = i (47 + 3^® - 2x 3 ®) = ~ (47 + 3(0.99958) - 2(3.00166)) = 1.99979, 

x 3 ® = “ (67 - 5^® - x 2 ®) = ^ (67 - 5(0.99958) - (1.99979)) = 3.00012. 

Fourth iteration 

x® = 4- (58 - 2x ® - 3x ®) = — (58 - 2(1.99979) - 3(3.00012)) = 1.00000, 

1 45 2 d 45 

x 2 ® = ^ (47 + 3x 1 (4) - 2 x 3 (3) ) = ^ (47 + 3(1.00000) - 2(3.00012)) = 1.99999, 

x 3 (4) = ^ (67 - 5*!® - x 2 (4) ) = ^ (67 - 5(1.00000) - (1.99999)) = 3.00000. 

We find | x^ 4) -x [ 3] > | = | 1.00000 - 0.99958 I = 0.00042, 

x' 4) -x^ 3) | = | 1.99999 - 1.99979 I = 0.00020, 

| x< 4) -xf | = | 3.00000 - 3.00012 | = 0.00012. 

Since, all the errors in magnitude are less than 0.0005, the required solution is 
Xj = 1.0, x 2 = 1.99999, x 3 = 3.0. 

Rounding to three decimal places, we get x 1 = 1.0, x 2 = 2.0, x 3 = 3.0. 

Example 1.23 Computationally show that Gauss-Seidel method applied to the system of 
equations 

3x 1 - 6 x 2 + 2x 3 = 23 
- 4x^ + x 2 - x 3 = - 8 
x 1 - 3x 2 + 7x 3 = 17 

diverges. Take the initial approximations as x 1 = 0.9, x 2 = - 3.1, x 3 = 0.9. Interchange the first 
and second equations and solve the resulting system by the Gauss-Seidel method. Again take 
the initial approximations as x 1 = 0.9, x 2 = - 3.1, x 3 = 0.9, and obtain the result correct to two 
decimal places. The exact solution is x 1 = 1.0, x 2 = - 3.0, x 3 = 1.0. 

Solution Note that the system of equations is not diagonally dominant. Gauss-Seidel method 
gives the iteration 

x« 4l > = [23 + 6x 2 ® - 2 x 3 ®)]/3 
x 2 ( * +1) = [_ 8 + 4x 1 ( * +1) + x 3 ®] 
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x 3 ( * +1) = [17 -x 1 w+1) + 3x 2 (A+1) ]/7. 

Starting with the initial approximations x 1 = 0.9, x 2 = - 3.1, x 3 = 0.9, we obtain the 
following results. 

First iteration 

x 3 (1) = | [23 + 6x 2 (0) - 2x 3 (0) ] = | [23 + 6(- 3.1) - 2(0.9)] = 0.8667, 

x 2 (1) = [- 8 + 4x x (1) + x 3 (0) ] = [- 8 + 4(0.8667) + 0.9] = - 3.6332, 

x 3 (1) = | [17 -Xj® + 3x 2 (1) ] = i [17 - (0.8667) + 3(- 3.6332)] = 0.7477. 

Second iteration 

x/ 2 > = | [23 + 6x 2 (1) - 2x 3 (1) ] = | [23 + 6 (- 3.6332) - 2(0.7477)] = - 0.0982, 
x 2 ® = [- 8 + 4*j® + x 3 (1) ] = [- 8 + 4(- 0.0982) + 0.7477] = - 7.6451, 
x 3 ® = * [17 -x® + 3 x 2 (2) ] = i [17 + 0.0982 + 3(- 7.6451)] = - 0.8339. 

Third iteration 

x x ® = | [23 + 6 x 2 (2) - 2x 3 (2) ] = | [23 + 6 (- 7.6451) - 2(- 0.8339)] = - 7.0676, 
x 2 (3) = [- 8 + 4xj (3) + x 3 (2) ] = [- 8 + 4(- 7.0676) - 0.8339] = - 37.1043, 
x 3 (3) = | [17 -x x (3) + 3 x 2 (3) ] = | [17 + 7.0676 + 3(- 37.1043)] = - 12.4636. 

It can be observed that the iterations are diverging very fast. 

Now, we exchange the first and second equations to obtain the system 
- 4x 1 + x 2 - x 3 = - 8 
3 x 3 - 6x 2 + 2x 3 = 23 
x 1 - 3 x 2 + 7x 3 = 17. 

The system of equations is now diagonally dominant. Gauss-Seidel method gives iteration 
x^ + « = [8 + x 2 ® - x 3 ( »]/4 
x 2 ik+r > = - [23 - 3x/* + « - 2 x 3 ( »]/6 

X&+1) = [17 _ + 3 J c 2 (*+i)]/7. 

Starting with the initial approximations x 3 = 0.9, x 2 = — 3.1, x 3 = 0.9, we obtain the 
following results. 

First iteration 

x ® = 4 [8 + x ® -x 3 (0) ] = \ [8 - 3.1 - 0.9] = 1.0, 

1 4 2. A 4 
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x 2 (1) = - — [23 - 3*,® - 2x 3 (0) ] = - 4 [23 - 3(1.0) - 2(0.9)] = - 3.0333, 

6 6 

x 3 (1) = y [17 - Xj® + 3x 2 (1) ] * | [17 - 1.0 + 3(- 3.0333)] = 0.9857. 

Second iteration 

xS 2) = \ [8 + x 2 (1) - x, (1) ] = 4 [8 - 3.0333 - 0.9857] = 0.9953, 

1 4 z a 4 

x 9 (2) = - - [23 - 3x< 2) - 2x, (1) ] = - ^ [23 - 3(0.9953) - 2(0.9857)] = - 3.0071, 

2 6 1 3 6 

= y [17 -Xj® + 3 x 2 (2) ] = y [17 - 0.9953 + 3(- 3.0071)] = 0.9976. 

Third iteration 

x,® = 4 [8 + x„ (2) - x, (2) ] = 4 [8 - 3.0071 - 0.9976] = 0.9988, 

1 4 z 3 4 

x 2 (3) = - | [23 - Satj® - 2 x 3 (2) ] = - | [23 - 3(0.9988) - 2(0.9976)] = - 3.0014, 

x 3 (3) = y [17 -Xj® + 3 x 2 (3) ] = i [17 - 0.9988 + 3(- 3.0014)] = 0.9996. 

Fourth iteration 

x. (4) = 4 [8 + x 2 (3) - x, (3) ] = 4 [8 - 3.0014 - 0.9996] = 0.9998, 

14 z A 4 

x 2 (4) = - — [23 - 3x< 4) - 2 x 3 (3) ] = - 4 [23 - 3(0.9998) - 2(0.9996)] = - 3.0002, 
6 6 

x 3 (4) = y [17 -* x (4) + 3 x 2 (4) ] m i [17 - 0.9998 + 3(- 3.0002)] = 0.9999. 

We find | x^ 4) -xj 3) | = | 0.9998 - 0.9988 I = 0.0010, 

xg 4) -4 3) = I - 3.0002 + 3.0014 | = 0.0012, 

x^ -xf 9 = | 0.9999 - 0.9996 I = 0.0003. 

Since, all the errors in magnitude are less than 0.005, the required solution is 

x 1 = 0.9998, x 2 = - 3.0002, x 3 = 0.9999. 

Rounding to two decimal places, we get x 1 = 1.0, x 2 = - 3.0, x 3 = 1.0. 
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- ( REVIEW QUESTIONS ) - 

1. Define an iterative procedure for solving a system of algebraic equations Ax = b. What 
do we mean by convergence of an iterative procedure? 

Solution A general linear iterative method for the solution of the system of equations 
Ax = b can be written in matrix form as 

x ( * +1) = Hx w + c, k = 0, 1 , 2 , ... 

where x (A+1) and x® are the approximations for x at the (k + l)th and &th iterations 
respectively. H is called the iteration matrix depending on A and c, which is a column 
vector depends on A and b. We start with an initial approximation to the solution vec¬ 
tor x = x 0 , and obtain a sequence of approximate vectors x 0 , x x .x ft ,... We say that the 

iteration converges if in the limit as k —» °°, the sequence of approximate vectors x 0 , 
Xj,..., x /; ,... converge to the exact solution vector x = A -1 b. 

2. How do we terminate an iterative procedure for the solution of a system of algebraic 
equations Ax = b ? 

Solution We terminate an iteration procedure when the magnitudes of the differences 
between the two successive iterates of all the variables are smaller than a given accu¬ 
racy or an error bound e, that is, 

| x\ k+1) -x | < e, for all i. 

For example, if we require two decimal places of accuracy, then we iterate until 
x +1) - x < 0.005, for all i. If we require three decimal places of accuracy, then we 
iterate until | x + 1) | < 0.0005, for all i. 

3. What is the condition of convergence of an iterative procedure for the solution of a 
system of linear algebraic equations Ax = b ? 

Solution A sufficient condition for convergence of an iterative method is that the sys¬ 
tem of equations is diagonally dominant, that is, the coefficient matrix A is diagonally 

dominant. We can verify that | a u \ > ^ | ay \. This implies that convergence may be 

obtained even if the system is not diagonally dominant. If the system is not diagonally 
dominant, we may exchange the equations, if possible, such that the new system is 
diagonally dominant and convergence is guaranteed. The necessary and sufficient con¬ 
dition for convergence is that the spectral radius of the iteration matrix H is less than 
one unit, that is, p(H) < 1, where p(H) is the largest eigen value in magnitude of H. 

4. Which method, Gauss-Jacobi method or Gauss-Seidel method converges faster, for the 
solution of a system of algebraic equations Ax = b ? 

Solution If both the Gauss-Jacobi and Gauss-Seidel methods converge, then Gauss- 
Seidel method converges at least two times faster than the Gauss-Jacobi method. 
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EXERCISE 1.3 


Solve the following system of equations using the Gauss-Jacobi iteration method. 

1. 20x + y - 2z = 17, 2. 21x + 6y - z = 85, 

3x + 2 Oy -z = - 18, x + y + 54z = 110, 

2x - 3y + 20z = 25. (A.U. Nov/Dec 2006) 6 x + 15y + 2z = 72. (A.U. May/ June 2006) 

3. x + 20y + z = - 18, 4. lOx + 4y - 2z = 20, 

25x + y - 5z = 19, 3x + 12 y - z = 28, 

3x + 4y + 8 z = 7. x + 4y + 7z = 2. 

SoZue the following system of equations using the Gauss-Seidel iteration method. 

5. 27x + 6y - z = 85, 6 . 4x + 2 y+z = 14, 

x + y + 54z = 110, x + 5y - z = 10, 

6 x + 15y + 2z = 72. x + y + 8 z = 20. 

(A. U. May /June 2006) (A. U. Apr /May 2005) 

7. x + 3y + 52z = 173.61, 
x-21y + 2z = 71.31, 

41x - 2y + 3z = 65.46. Start with x = 1, y = - 1, z = 3. ( A.U. Apr /May 2004) 


8 . 20x - y - 2z = 17, 
3x + 20 y - z = - 18, 
2x - 3 y + 20 z = 25. 

9. x + 20y + z = - 18, 
25x + y - 5z = 19, 
3x + 4y + 8z = 7. 


(A.U. Nov/Dec 2003) 

10. lOx + 4y - 2z = 20, 

3x + 12 y - z = 28, 
x + 4y + 7z = 2. 


1.3 EIGEN VALUE PROBLEMS 

1.3.1 Introduction 

The concept of eigen values and finding eigen values and eigen vectors of a given matrix are 
very important for engineers and scientists. 

Consider the eigen value problem 

Ax = Xx. (1.49) 

The eigen values of a matrix A are given by the roots of the characteristic equation 

I A - X I I = 0. (1.50) 

If the matrix A is of order n, then expanding the determinant, we obtain the character¬ 
istic equation as 


pi A.) — (— l) n h n + afk n 1 + ... + a nl X + a n — 0. 


(1.51) 
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For any given matrix we write the characteristic equation (1.50), expand it and find the 
roots A, ls X 2 ,..., X n , which are the eigen values. The roots may be real, repeated or complex. Let 
x. be the solution of the system of the homogeneous equations (1.49), corresponding to the 
eigen value X v These vectors x ; , i = 1, 2, ..., n are called the eigen vectors of the system. 

There are several methods for finding the eigen values of a general matrix or a symmet¬ 
ric matrix. In the syllabus, only the power method for finding the largest eigen value in mag¬ 
nitude of a matrix and the corresponding eigen vector, is included. 

1.3.2 Power Method 

The method for finding the largest eigen value in magnitude and the corresponding eigen 
vector of the eigen value problem Ax = X x, is called the power method. 

What is the importance of this method ? Let us re-look at the Remarks 20 and 23. The 
necessary and sufficient condition for convergence of the Gauss-Jacobi and Gauss-Seidel 
iteration methods is that the spectral radius of the iteration matrix H is less than one unit, 
that is, p(H) < 1, where p(H) is the largest eigen value in magnitude of H. If we write the 
matrix formulations of the methods, then we know H. We can now find the largest eigen value 
in magnitude of H, which determines whether the methods converge or not. 

We assume that X 1 , X 2 ,..., X n are distinct eigen values such that 

Uj | > U 2 | > ... > U„ I. (1.52) 

Let v 1; v 2 ,..., \ n be the eigen vectors corresponding to the eigen values Xj, X 2 ,..., X n , 
respectively. The method is applicable if a complete system of n linearly independent eigen 
vectors exist, even though some of the eigen values X 2 , X 3 ,..., X n , may not be distinct. The n 
linearly independent eigen vectors form an n-dimensional vector space. Any vector v in this 
space of eigen vectors v x , v 2 ,..., \ n can be written as a linear combination of these vectors. That 
is, 

V = CjVi + c 2 v 2 + ... + c n v„. (1.53) 

Premultiplying by A and substituting Av x = ^ 1 v 1 , Av 2 = X 2 \ 2 ,..., Av n = X n \ n , we get 
Av = c 1 A, 1 v 1 + c 2 X 2 v 2 + ... + c n X n \ n 



Premultiplying repeatedly by A and simplifying, we get 



(1.54) 
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As k -» °°, the right hand sides of (1.54) and (1.55) tend to 'k k l c l \ l and A,* + 1 c 1 v 1 , since 
I I < 1, i = 2, 3, ..., n. Both the right hand side vectors in (1.54), (1.55) 

jCjVj + C 2 (VV* V 2 + - + C n V J> 

and [c 1 v 1 + c 2 (X 2 /X 1 ) k+1 v 2 + ... + c n (A, n /A , 1 )* +1 vj 

tend to c 1 v 1 , which is the eigen vector corresponding to X 1 . The eigen value is obtained as 
the ratio of the corresponding components of A* +1 v and A k v. That is, 

X = lhn (A V)r , r = 1, 2, 3, ..., n (1.56) 

1 (A®v) r 

where the suffix r denotes the rth component of the vector. Therefore, we obtain n ratios, all of 
them tending to the same value, which is the largest eigen value in magnitude, 1 ^ 1 . 

When do we stop the iteration The iterations are stopped when all the magnitudes of the 
differences of the ratios are less than the given error tolerance. 

Remark 24 The choice of the initial approximation vector v 0 is important. If no suitable 
approximation is available, we can choose v 0 with all its components as one unit, that is, 
v 0 = [1, 1, 1,..., 1] T . However, this initial approximation to the vector should be non-orthogonal 
to v r 

Remark 25 Faster convergence is obtained when | h 2 I « I I . 

As k —> °° , premultiplication each time by A, may introduce round-off errors. In order to 
keep the round-off errors under control, we normalize the vector before premultiplying by A. 
The normalization that we use is to make the largest element in magnitude as unity. If we use 
this normalization, a simple algorithm for the power method can be written as follows. 

y* + i = Av a , (1.57) 

v * + i = y k J m k + i d- 58 ) 

where m k+1 is the largest element in magnitude of y A+1 . Now, the largest element in magni¬ 
tude of \ k+1 is one unit. Then (1.56) can be written as 

. = lim frfr-fe r = 1, 2, 3. n (1.59) 

(v A ) r 

and x k+1 is the required eigen vector. 

Remark 26 It may be noted that as k -» °° , m k+1 also gives 1^1. 

Remark 27 Power method gives the largest eigen value in magnitude. If the sign of the eigen 
value is required, then we substitute this value in the determinant I A - X x I I and find its 
value. If this value is approximately zero, then the eigen value is of positive sign. Otherwise, 
it is of negative sign. 

Example 1.24 Determine the dominant eigen value of A = by power method. 


( A.U. Nov/Dec 2004 ) 
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Solution Let the initial approximation to the eigen vector be v 0 . Then, the power method is 
given by 

y* + i = Av *> 

v * + i = YkJ m k + i 

where m k+1 is the largest element in magnitude of y fe+1 . The dominant eigen value in magni¬ 
tude is given by 

(y, , ) 

JL = lim k+1 ’ r , r = 1, 2, 3, n 
1 (v*) r 

and \ k+1 is the required eigen vector. 

Let v 0 = [1 1] T . We have the following results. 

Y2_ 1 [2.42857] [0.45946] 

V2 “m 2 5.285711_5.28571J [ 1 ]' 


y 3 = Av 2 


fl 2] [0.45946] [2.45946] 

|_3 4 J |_ 1 J |_ 5 . 37838_|’ m 3 - 5 - 37838 - 


[2.45946] 

[0.45729] 

[5.37838] 

= L i } 

'0.45729] 

[2.45729] 

. 1 J 1 

[5.37187]’ : 


[2.45729] _ [0.45744] 


4 “m 4 5.37187 [5.37187] [ 1 ] 

. [1 2] [0.45744] _ [2.45744] _ „„ OQO 

y 5 - Av 4-|^ 3 4 J|^ x J [ 5 . 37232 J> m 4~ 5.37232, 


Now, we find the ratios 


= lim 


(ym)t 

(v*)r 


[2.45744] 

[0.45743] 

[5.37232] 

L 1 J- 

[0.45743] 1 

'2.45743] 

L 1 n 

5.37229]- 

r = 1, 2. 
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We obtain the ratios as 


2.45743 

0.45743 


= 5.37225, 


5.37229. 


The magnitude of the error between the ratios is | 5.37225 - 5.37229 | = 0.00004 
< 0.00005. Hence, the dominant eigen value, correct to four decimal places is 5.3722. 


Example 1.25 Determine the numerically largest eigen value and the corresponding eigen 
vector of the following matrix, using the power method. 


'25 1 2 ' 

13 0 

2 0-4 


(A.U. May /June 2006) 


Solution Let the initial approximation to the eigen vector be v 0 . Then, the power method is 
given by 

y* + i = Av *> 

v * + i = y k J m k + i 

where m k+1 is the largest element in magnitude of y k+1 . The dominant eigen value in magni¬ 
tude is given by 

(y*+l)r 

X, = lim ——-— r = 1, 2, 3, ..., n 

1 (v*) r ’ 

and v k+1 is the required eigen vector. 

Let the initial approximation to the eigen vector be v 0 = [1, 1, l] 7 . We have the following 
results. 


'25 

1 

2 ' 

1 ' 


'28' 

1 

3 

0 

1 

= 

4 

2 

0 

-4 

1 


-2 



1 

0.14286 
- 0.07143 


r 25 

1 

2 1 

| 1 1 

[25.00001 

1 

3 

o 

0.14286 

= 1.42858 1 

u 

0 -4j 

0.07143J 

(_2.28572j 


'25.00000' 


1 

1.14286 

= 

0.05714 

2.28572 


0.09143 


'25 1 2 ' 

1 


'25.24000' 

13 0 

0.05714 

= 

1.17142 

2 0-4 

0.09143 


1.63428 
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'25.24000' 


1 

1.17142 

= 

0.04641 

1.63428 


0.06475 


'25 

1 

2 ' 

1 


'25.17591' 

1 

3 

0 

0.04641 

= 

1.13923 

2 

0 

-4 

0.06475 


1.74100 


v 4 = 


y 4 = 


1 

25.17591 


'25.17591' 


1 

1.13923 

= 

0.04525 

1.74100 


0.06915 



'25 1 2 ' 

1 

25.18355" 

y 5 = Av 4 = 

13 0 

0.04525 = 

1.13575 


2 0-4 

0.06915 

1.72340 

1 


25.18355' 

1 

= — y„= - 

1.13575 

= 0.04510 

m 5 

' 25.18355 

1.72340 

0.06843 


25 1 2 ' 

1 

'25.18196' 

y 6 = Av 5 = 

13 0 

0.04510 = 

1.13530 


2 0-4 

0.06843 

1.72628 

1 


'25.18196' 

1 

= — y fi = - 

1.13530 

= 0.04508 

m 6 

25.18196 

1.72628 

0.06855 


25 1 2 ' 

1 

'25.18218' 

y 7 = Av 6 = 

13 0 

0.04508 = 

1.13524 


2 0-4 

0.06855 

1.72580 

1 


25.18218" 

1 

v, = — y, =- 

1.13524 

= 0.04508 

m 7 

25.18218 

1.72580 

0.06853 


"25 1 2 ' 

1 


'25.18214' 

13 0 

0.04508 

= 

1.13524 

2 0-4 

0.06853 


1.72588 


JL= r = 1, 2, 3. 

1 (v*) r 


i 4 = 25.17591, 


5 = 25.18355, 


= 25.18196, 


7 = 25.18218, 


8 = 25.18214. 


Now, we find the ratios 
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We obtain the ratios as 


1.13524 

25.18214, = 25.18279, 

’ 0.04508 


1.72588 

0.06853 


= 25.18430. 


The magnitudes of the errors of the differences of these ratios are 0.00065, 0.00216, 
0.00151, which are less than 0.005. Hence, the results are correct to two decimal places. There¬ 
fore, the largest eigen value in magnitude is | | =25.18. 

The corresponding eigen vector is v g , 



1 

25.18214 


'25.18214' 


1 

1.13524 

= 

0.04508 

1.72588 


0.06854 


In Remark 26, we have noted that as k -> °°, m k+1 also gives | |. We find that this 

statement is true since | m g -m 7 | = | 25.18214-25.18220 | = 0.00006. 

If we require the sign of the eigen value, we substitute in the characteristic equation. 
In the present problem, we find that | A - 25.18 I | = 1.4018, while | A + 25.18 I | is very 
large. Therefore, the required eigen value is 25.18. 


- ( REVIEW QUESTIONS j - 

1. When do we use the power method? 

Solution We use the power method to find the largest eigen value in magnitude and 
the corresponding eigen vector of a matrix A. 

2. Describe the power method. 

Solution Power method can be written as follows. 
y* + i = Av *> 
v * + i = y k+ i /m k + i 

where m k+1 is the largest element in magnitude of y k+r Now, the largest element in 
magnitude of \ k+1 is one unit. The largest eigen value in magnitude is given by 

X. = lim (y * +l)r , r = 1, 2, 3, ..., n 

(v k ) r 

and \ k+1 is the required eigen vector. All the ratios in the above equation tend to the 
same number. 

3. When do we stop the iterations in power method? 

Solution Power method can be written as follows. 

y* + i = Av k’ 
v &+i = y k+ i /m k + i 

where is the largest element in magnitude of y jfe+1 . Now, the largest element in 

magnitude of \ k+1 is one unit. The largest eigen value is given by 
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X, = lim , r = 1, 2, 3, n 

an d v /;+1 is the required eigen vector. All the ratios in the above equation tend to the 
same number. The iterations are stopped when all the magnitudes of the differences of 
the ratios are less than the given error tolerance. 

4. When can we expect faster convergence in power method? 

Solution To apply power method, we assume | A. x | > | X 2 \ > ... > | X n \ . Faster 
convergence is obtained when | X 2 \ « \ X 1 \. That is, the leading eigen value in 
magnitude is much larger than the remaining eigen values in magnitudes. 

5. Does the power method give the sign of the largest eigen value? 

Solution No. Power method gives the largest eigen value in magnitude. If the sign of 
the eigen value is required, then we substitute this value in the characteristic determi¬ 
nant | A - | and determine the sign of the eigen value. If | A - | = 0 is satisfied 

approximately, then it is of positive sign. Otherwise, it is of negative sign. 


- f EXERCISE 1.4 ) - 

Determine the largest eigen value in magnitude and the corresponding eigen vector of 
the following matrices by power method. Use suitable initial approximation to the eigen 
vector. 



1 3 - T 


'1-3 2' 

1 . 

3 2 4 

-1 4 10 

(A.U. Nov/Dec 2003) 2. 

4 4-1 

6 3 5 


(. A.U. Apr /May 2005 ) 



'35 

2 

1 ' 


'20 1 

1' 


'6 

1 

O' 

3. 

2 

3 

0 

4. 

1 3 

0 

5. 

1 

40 

1 


1 

0 

-1 


1 0 

1 


0 

1 

6 


15 

2 

1 ' 


'3 1 

5 ' 


'65 

0 

1" 

6. 

0 

3 

2 

7. 

1 0 

2 

8. 

0 

5 

0 


0 

0 

-1 


5 2 

-1 


1 

0 

2 


1.4 ANSWERS AND HINTS 


Exercise 1.1 

1. (2, 3); x 0 = 2 , x, = 3, x 2 = 2.058824, x 3 = 2.081264, x 4 = 2.089639, x 5 = 2.092740. 

2. (2, 3); Xq = 2,x x = 3, x 2 = 2.721014, x 3 = 2.740205, x 4 = 2.740637, | x 4 - x 3 | = 0.000432. 
Root correct up to 4 decimal places is x 4 . 

3. Xq = 2.5, = 3, x 2 = 2.801252, x 3 = 2.798493, x 4 = 2.798390, | x 4 - x 3 | = 0.000103. Root 

correct up to 3 decimal places is x 4 . 
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4. (1, 2);x 0 = 1, x 4 = 2,x 2 = 1.023360,x 3 = 1.035841,x 4 = 1.042470,x 5 = 1.045980, | x 5 -x 4 | 
= 0.00351. Root correct up to 2 decimal places is x 5 . 

5. (0, 1); Xq = 0,x 1 = 1, x 2 = 0.612700, x 3 = 0.572182, x 4 = 0.567703, x 5 = 0.567206, |x 5 - x 4 
| = 0.000497. Root correct up to 3 decimal places is x 5 . 

6. (1, 2); x 0 = 1, x a = 2, x 2 = 1.636364, x 3 = 1.828197, x 4 = 1.852441, x 5 = 1.855228, x 6 
= 1.855544, | x 6 - x 5 | = 0.000316. Root correct up to 3 decimal places is x 6 . 

7. (1, 2); x 0 = 2, x x = 1.870968, x 2 = 1.855781, x 3 = 1.855585, | x 3 - x 2 | = 0.000196. Root 
correct up to 3 decimal places is x 3 . 

8. (0, 1); x 0 = 1, x 4 = 0.666667, x 2 = 0.730159, x 3 = 0.732049, | x 3 - x 2 | = 0.00189. Root 
correct up to 2 decimal places is x 3 . 

9. (0, 1); x 0 = l,x 1 = 0.620016, x 2 = 0.607121, x 3 = 0.607102, | x 3 - x 2 | = 0.000019. Root 
correct up to 4 decimal places is x 3 . 

10. (2, 3); x 0 = 3, x 4 = 2.746149, x 2 = 2.740649, x 3 = 2.740646, | x 3 - x 2 | = 0.000003. Root 
correct up to 3 decimal places is x 3 . 

11. x 0 = 1.9, x 1 = 1.895506,x 2 = 1.895494, | x 2 -x 1 \ = 0.000012. Root correct up to 3 decimal 
places is x 2 . 

12 ' <iU ** 1= 4iT’ * =0 ' 1 "- 

(ii) N = 142; x 0 = 12, x x = 11.916667, x 2 = 11.916375, | x 2 - x x | = 0.000292. Root correct 
up to 3 decimal places is x 2 . 

13. (i) x k+1 = 2x k - Nxl, k = 0, 1, ... 

Hi) N = 26;x 0 = 0.04,x 4 = 0.0384,x 2 = 0.038461,x 3 = 0.038462, |x 3 -x 2 | = 0.000001. The 
required root is x 3 . 

14. x„ = — 1.5, x 4 = — 1.293764, x 2 = - 1.250869, x 3 = - 1.249055, x 4 = - 1.249052, | x 4 - x 3 | 
= 0.000003. Root correct up to 3 decimal places is x 4 . 

15. (0, 1); x 0 = 1, x 4 = 1.051819, x 2 = 1.049912, x 3 = 1.049909, | x 3 - x 2 | = 0.000003. Root 
correct up to 3 decimal places is x 3 . 

16. (0, 1); x k+1 = [(x A 3 + l)/5] = (t>(x A ), k = 0,1,2,... x 0 = 0, x 4 = 0.2, x 2 = 0.2016, 

x 3 = 0.201639, | x 3 - x 2 | = 0.000039. Root correct up to 4 decimal places is x 3 . 

17. (0, 1); x k+1 = Kx k 5 + 30)/64] = ty(x k ), k = 0, 1, 2,... x 0 = 0, x x = 0.46875, x 2 = 0.469104, 
x 3 = 0.469105, | x 3 - x 2 | = 0.000001. Root correct up to 4 decimal places is x 3 . 

18. (- 1, 0); x*, +1 = [{x k - D/3] 173 = <t?(x k ), k = 0,l, 2,... x 0 = - 1, x x = - 0.87358, 

x 2 = - 0.854772, x 3 = - 0.851902, x 4 = - 0.851463, x 5 = - 0.851395, x 6 = - 0.851385, 

| x 6 - x 5 | = 0.00001. Root correct up to 4 decimal places is x 6 . 

19. (0, 1); x 0 = 0, x x = 1, x 2 = 0.367879, x 3 = 0.692201, x 4 = 0.500473.x 12 = 0.566415, 

x 13 = 0.567557, | x 13 - x 12 | = 0.001142. Root correct up to 2 decimal places is x 13 . 
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20. (0, 1); x k+1 = [(1 + cos x k )IS\ = facj, k = 0,l, 2,... x 0 = 0, x 4 = 0.666667, 

x 2 = 0.595296, x 3 = 0.609328, x 4 = 0.606678, x 5 = 0.607182, x 6 = 0.607086, 
| x 6 - x 5 | = 0.000096. Root correct up to 3 decimal places is x 6 . 

21. We have a + P = -a,aP = 6. 

...... ax + b b aB _ , , 

(i) (p(x) = --, q) (x) =- y =- y -. 1 or convergence to a, we have 


I <|>'(a) | = |- (ap)/a 2 | < 1, or | a | > | p |. 


Hi) <])(x) = - - 


-» 4 >'(*) = ; 


ap 


(x + a) (x-oc-pF 
| <>'(a) | = | (ap)/p 2 | < 1, or | a | < | P |. 


. For convergence to a, we have 


Exercise 1.2 

1. x = 1.70869, y = - 1.80032, 2 = 1.04909. 2. x = - 4.5,3/= 2.5, 2 = 5. 


4. x 1 = 1, x 2 = - 1, x 3 = - 1, x 4 = 1. 
6. x = 1, y = 2, 2 = 3. 

8.x = 1,3/ = 1/2,2 = -1/2. 


3. x = 1,3/ = - 5,2 = 1. 
5. x = 1,3' = 1, 2 = 1. 

7. x = 1,3/ = - 5,2 = 1. 


9. 


U ‘ 56 

In Problems 13-16, Gauss elimination gives the following results. 
0 " 


"-6 

5 -1 


' 24 

8 

12' 

24 

-17 3 

10. g 

-10 

-2 

-6 

-10 

7 -1 

8 [ 

-2 

-2 

-2 


'12 4 6 ' 


'5 - 1 - 2' 

15-3 

12 . 

5 -1-7 

5 -3-1 

5 

-5 2 4 



'2 

1 

-3 

13. 

0 

11/2 

17/2 


0 

0 

0 


'l 

-3 

4 I 2 " 

14. 

0 

4 

-5-2 


0 

0 

0 2 


'2 

1 

-3 I 

15. 

0 

11/2 

17/2 


0 

0 

0 

one 

parameter fa: 


1 

5 

-1 o' 

16. 

0 

-7 

3 11 • 


0 

0 

0 0 j 


; rank (A) = 2; rank (A | b) = 3. The system is inconsistent. 


; rank (A) = 2; rank (A | b) = 3. The system is inconsistent. 


; rank (A) = 2; rank (A | b) = 2. The system is consistent and has 


; rank (A) = 2; rank (A | b) = 2. The system is consistent and has one 
parameter family of solutions. 
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Exercise 1.3 

In all the Problems, values for four iterations have been given. Solutions are the transposes of 
the given vectors. 

1. [0, 0, 0], [0.85, - 0.9, 1.25], [1.02, - 0.965, 1.03], [1.00125, - 1.0015, 1.00325], 

[1.00040, - 0.99990, 0.99965], Exact: [1, - 1, 1]. 

2. [0, 0, 0], [3.14815, 4.8, 2.03704], [2.15693, 3.26913,1.88985], [2.49167, 3.68525,1.93655], 
[2.40093, 3.54513, 1.92265]. 

3. Exchange the first and second rows. [0, 0, 0], [0.76, - 0.9, 0.875], [0.971, - 0.98175, 
1.04], [1.00727, - 1.00055, 1.00175], [1.00037, - 1.00045, 0.99755], Exact: [1, - 1, 1]. 

4. [0, 0, 0], [2.0, 2.33333, 0.28571], [1.12381, 1.85714, - 1.33333], [0.99048, 1.94127, 

- 0.93605], [1.03628, 2.00771, - 0.96508]. Exact: [1, 2,-1], 

5. [0, 0, 0], [3.14815, 3.54074, 1.91317], [2.43218, 3.57204, 1.92585], [2.42569, 3.57294, 
1.92595], [2.42549, 3.57301, 1.92595], 

6. [0, 0, 0], [3.5, 1.3, 1.9], [2.375, 1.905, 1.965], [2.05625, 1.98175, 1.99525], [2.01031, 
1.99700, 1.99909], Exact: [2, 2, 2], 

7. Interchange first and third rows. [1, - 1, 3], [1.32829, - 2.36969, 3.44982], [1.22856, 

- 2.34007, 3.45003], [1.22999, - 2.34000, 3.45000], [1.23000, - 2.34000, 3.45000]. 

8. [0, 0, 0], [0.85, - 1.0275, 1.01088], [0.89971, - 0.98441, 1.01237], [0.90202, - 0.98468, 
1.01210], [0.90200, - 0.98469, 1.01210], 

9. Interchange first and second rows. [0, 0, 0], [0.76, - 0.938, 1.059], [1.00932, - 1.00342, 
0.99821], [0.99978, - 0.99990, 1.00003], [1.0, - 1.0, 1.0]. 

10. [0, 0, 0], [2.0, 1.83333, - 1.04762], [1.05714, 1.98175, - 0.99773], [1.00775, 1.99825, 

- 1.00011], [1.00068, 1.99982, - 0.99989], Exact: [1, 2,-1], 

Exercise 1.4 

In all problems, we have taken v (0) = [1, 1, 1], The results obtained after 8 iterations are given. 
Solutions are the transposes of the given vectors. 

1. | K | = 11.66, v = [0.02496, 0.42180, 1.0]. 2. | X j » 6.98, v = [0.29737, 0.06690, 1.0]. 

3. 1| = 35.15, v = [1.0, 0.06220, 0.02766], 4. | X \ = 20.11, v = [1.0, 0.05316, 0.04759], 

5. | X | = 40.06, v = [0.02936, 1.0, 0.02936]. 6. | k |* 15, v = [1.0, 0.00002, 0.0]. 

7. \X\ = 6.92, v = [1.0, 0.35080, 0.72091]. 8. | X \ = 65.02, v = [1.0, 0.0, 0.01587]. 
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Interpolation and Approximation 


2.1 INTRODUCTION 

In this chapter, we discuss the problem of approximating a given function by polynomials. 
There are two main uses of these approximating polynomials. The first use is to reconstruct 
the function fix) when it is not given explicitly and only values of fix) and/ or its certain order 
derivatives are given at a set of distinct points called nodes or tabular points. The second use 
is to perform the required operations which were intended for fix), like determination of roots, 
differentiation and integration etc. can be carried out using the approximating polynomial 
P(x). The approximating polynomial P(x) can be used to predict the value of fix ) at a non- 
tabular point. The deviation of P(x) from fix), that is fix) - Pix), is called the error of approxi¬ 
mation. 

Let fix) be a continuous function defined on some interval [a, 6], and be prescribed 
at n + 1 distinct tabular points x 0 , x v ..., x n such that a = x 0 < x 1 < x 2 < ... < x n = b. The distinct 
tabular points x 0 , x v ..., x n may be non-equispaced or equispaced, that is x k+1 - x k = h, k = 0,1, 
2,..., n -1. The problem of polynomial approximation is to find a polynomial P n ix), of degree 
< n, which fits the given data exactly, that is, 

P n (xf) = fix), i = 0, 1, 2,,.., n. (2.1) 

The polynomial P n ix) is called the interpolating polynomial. The conditions given in 
(2.1) are called the interpolating conditions. 

Remark 1 Through two distinct points, we can construct a unique polynomial of degree 1 
(straight line). Through three distinct points, we can construct a unique polynomial of degree 
2 (parabola) or a unique polynomial of degreel (straight line). That is, through three distinct 
points, we can construct a unique polynomial of degree < 2. In general, through n + 1 distinct 
points, we can construct a unique polynomial of degree < n. The interpolation polynomial 
fitting a given data is unique. We may express it in various forms but are otherwise the same 
polynomial. For example, fix) = x 2 - 2x - 1 can be written as 
x 2 - 2x - 1 = — 2 + (x - 1) + (x - 1) (x - 2). 


63 
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2.2 INTERPOLATION WITH UNEVENLY SPACED POINTS 

2.2.1 Lagrange Interpolation 

Let the data 


X 

x o 

X, 

x 2 


X n 

fix) 

/tv 

fix i) 

/tv 


fiX n ) 


be given at distinct unevenly spaced points or non-uniform points x 0 , x 1 . x n . This data may 

also be given at evenly spaced points. 

For this data, we can fit a unique polynomial of degree < n. Since the interpolating 
polynomial must use all the ordinates /(x 0 ), fix^,... fixj, it can be written as a linear combina¬ 
tion of these ordinates. That is, we can write the polynomial as 

P n (x) = Z 0 (x) fix 0 ) + IjOc) fhcj + ... + l n (x) fix n ) 

= Z 0 (x) f 0 + Ijb) /i + ... + l n (x) fix n ) (2.2) 

where fixj) = f L and Ifx), i = 0, 1, 2, ...,n are polynomials of degree n. This polynomial fits the 
data given in (2.1) exactly. 

At x = x Q , we get 

fix 0 ) = P n (x 0 ) = Z 0 (x 0 ) fix 0 ) + I^Xq) fix,) + ... + l n (x 0 ) flx n ). 

This equation is satisfied only when Z 0 (x 0 ) = 1 and l t ix 0 ) = 0, i * 0. 

At a general point x = x-, we get 

fix t ) = P n (x) = Z 0 (xp /(x 0 ) + ... + Z/x.) /(x.) + ... + l n {x) fhc n ). 

This equation is satisfied only when Z/xp = 1 and Ifici) = 0 ,i* j. 

Therefore, Z-(x)> which are polynomials of degree n, satisfy the conditions 


[0, i * j 

W = |l, i~y 


Since, Z-(x) = 0 at x = x 0 , x 1 ,..., x i V x t + 1 , ..., x n , we know that 


(2.3) 


(x - x 0 ), (x - X-,),..., (x - x w ), (x - X i+1 ),..., (x - x n ) 

are factors of Ifx). The product of these factors is a polynomial of degree n. Therefore, we can 
write 


Z/x) = C(x - x 0 ) (x - x.,)...(x - x i X ) (x - x- +1 )...(x - x n ) 

where C is a constant. 

Now, since Z ; (xp = 1, we get 

IjiXj) = 1 = C(x i - x 0 ) (x t - x 1 )...(x l - x^j) ix i - x i+1 )...(x i - x n ). 
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Hence, 


C = 


_ 1 _ 

( x t -X 0 )(Xi -Xi)..,(x i -x t _ i)(Xj- -X i+1 )...(Xi -X n ) ' 


Therefore, 


(x -X 0 )(x -X^.-.jx -Xj-jKx -x i+1 )...jx -x n ) 
(x t -X 0 )(Xi -X^.-iXi -X i _ 1 )(x i -x i+1 )...(Xi -X n ) 


(2.4) 


Note that the denominator on the right hand side of Ifx) is obtained by setting x = x- in 
the numerator. 

The polynomial given in (2.2) where Z-(x) are defined by (2.4) is called the Lagrange 
interpolating polynomial and Ifx) are called the Lagrange fundamental polynomials. 

We can write the Lagrange fundamental polynomials lfx) in a simple notation. 

Denote w(x) = (x - x 0 ) (x - Xjh.Xx - x n ) 

which is the product of all factors. Differentiating w(x) with respect to x and substituting x = x t 
we get 

w'ixf = (x t - x 0 ) (x i - x x )...(x. - x w ) (x i - x i+ 1 )...(x i - x n ) 
since all other terms vanish. Therefore, we can also write fix) as 


fix) = 7 - 7 77 — 7 - 

(x -Xi)W (Xi) 

Let us derive the linear and quadratic interpolating polynomials. 
Linear interpolation 
For n = 1, we have the data 

X Xq x 1 

fix) fix 0 ) fixf) 

The Lagrange fundamental polynomials are given by 


l 0 ix) = 


(x-x-l) 

(xo - Xi) 


, Z x (x) = 


(x -Xq) 
(Xi -X 0 ) ‘ 


The Lagrange linear interpolation polynomial is given by 


P 1 (x) = Z 0 (x)/(x 0 ) + Z 1 (x)/(x 1 ). 

Quadratic interpolation 

For n = 2, we have the data 

x x 0 x x x 2 

fix) fix 0 ) fix x ) fix 2 ) 
The Lagrange fundamental polynomials are given by 


(2.5) 


(2.6) 

(2.7) 


(x — x t )(x -x 2 ) ^ ^ _ (x — x 0 )(x — x 2 ) ^ ^ _ (x -x 0 )(x -x x ) 

(x 0 -Xi)(xo-X 2 )’ 1 (x x -X 0 )(X!-x 2 ) ’ 2 (x 2 —x 0 )(x 2 — X\) 
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The Lagrange quadratic interpolation polynomial is given by 

P 1 (*) = l 0 (x) fix 0 ) + l t (x) fixj + l 2 (x) f(x 2 ). (2.8) 

Error of interpolation 

We assume that fix) has continuous derivatives of order up to n + 1 for all x e (a, b). 
Since, fix) is approximated by P n (x), the results contain errors. We define the error of interpo¬ 
lation or truncation error as 


E(f,x)=f(x)-P n (x). (2.9) 

Without giving the derivation, we write the expression for the error of interpolation as 
E(f, x) = fix) - PJx) 


(x -x 0 )(x -X^-Xx-x n ) 
(n + 1)! 


f <n+1) Of = 


w(x) 

(n+1)! 


/■ (n+ (2.10) 


where min(x Q , x 1 . x n , x) < q < max(x Q , x v ..., x n , x). 

Since, t, is an unknown, it is difficult to find the value of the error. However, we can find 
a bound of the error. The bound of the error is obtained as 


1 E(f ’ X) 1 = (n +1)! 1 (x " X o } (x " x i } - (x “' x » ) 1 1 ^ & 1 


< t — [maxKx -x 0 )(x-Xi)...(x - *„) |1 [max \f (n+v> (x)|l 
(n + 1)! \_a<x<b J [_a<x<b J 

( 2 . 11 ) 

Note that in (2.11), we compute the maximum absolute value of 
w(x) = (x - x 0 )(x - xf...(x - x n ), that is max | w(x) | and not the maximum of w(x). 

Since the interpolating polynomial is unique, the error of interpolation is also unique, 
that is, the error is same whichever form of the polynomial is used. 

Example 2.1 Using the data sin(O.l) = 0.09983 and sin (0.2) = 0.19867, find an approximate 
value of sin (0.15) by Lagrange interpolation. Obtain a bound on the error at x = 0.15. 

Solution We have two data values. The Lagrange linear polynomial is given by 


Pfx) = 


(«-*!) 

(*o 


f(x 0 ) + 


(x - Xq) 
(*1 -*()) 


fixf 


(x - 0.2) 
(0.1-0.2) 


(0.09983) + ( ( * 2 ^ (0.19867). 


Hence, /(0.15) = P^O.15) = ^ (0.09983) + { ^_ ^ (0.19867) 


= (0.5) (0.09983) + (0.5) (0.19867) = 0.14925. 
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The truncation error is given by 

TE= (x -x 0 )(x-x !) ^ = (x - 0.1)(x - 0.2) 

since f{x) = sin x. At x = 0.15, we obtain the bound as 


(-sin 5), 0.1 <^<0.2. 


. (0.15-0.1) (0.15-0.2) 


(- sin t) = 0.00125 sin ^ 


= 0.00125 sin (0.2) = 0.00125(0.19867) = 0.00025. 

Example 2.2 Use Lagrange’s formula, to find the quadratic polynomial that takes the values 


(A.U Nov I Dec. 2005) 


Solution Since f 0 = 0 and f 2 = 0, we need to compute Ifx) only. We have 

(x-x 0 )(x -x 2 ) _ x(x-3) _l 
l l M= ( Xl -x 0 )( Xl -x 2 )~ (1)(-2) ~ 2 (3 *- x 

The Lagrange quadratic polynomial is given by 


m = Ifx) /(*!) = | (3* - x 2 ) (1) =| (3x - x 2 ). 

Example 2.3 Given that f( 0) = 1, f(l) = 3, f(3) = 55, find the unique polynomial of degree 2 or 
less, which fits the given data. 

Solution We have x 0 = 0, f 0 = 1, x, = 1 , f 1 = 3, x 2 = 3 , f 2 = 55. The Lagrange fundamental 
polynomials are given by 


j , _ (x -x x )(x — x 2 ) _ (x -l)(x -3) 
° X ~ (x 0 - Xl )(x 0 -x 2 )~ (— 1)(— 3) 

^ , s _ (x — x 0 ) (x — X 2 ) _ X (x - 3) _ i 
lX - (x 1 -x 0 )(x 1 -x 2 )~ (1)(-2) - 2 

(x —x 0 )(x — xf) _ x (x — 1) _ 1 
2(X) ~ (x 2 -x 0 )(x 2 -x 1 ) _ (3)(2) _ 6 
Hence, the Lagrange quadratic polynomial is given by 

P 2 (x) = Z 0 (x) /(x 0 ) + Ifx) flxf + l 2 (x) fix 2 ) 


- = |(x 2 -4x + 3). 
(3x - x 2 ). 

(x 2 — x). 


= ^ (x 2 - 4x + 3) + ^ (3x - x 2 ) (3) + ^ (x 2 - x) = 8x 2 - 6x + 1. 



















68 


NUMERICAL METHODS 


Example 2.4 The following values of the function fix) = sin x + cos x, are given 


* 

10 0 

20° 

30° 

fix) 

1.1585 

1.2817 

1.3660 


Construct the quadratic Lagrange interpolating polynomial that fits the data. Hence, find 
/■(jt/12). Compare with the exact value. 

Solution Since the value of f at ji/ 12 radians is required, we convert the data into radian 
measure. We have 


The Lagrange fundamental polynomials are given by 

te-*i)(x-x 2 ) _ (x-0,3491) (x-0.5236) 


l 0 (x) = 


Ijfpc) = 


l 2 (x) = 


(* 0 -*i) (* 0 - * 2 ) (- 0.1746) (- 0.3491) 

16.4061 (.* 2 - 0.8727* + 0.1828). 

(x-x 0 )(x-x 2 ) (x - 0.1745) (x - 0.5236) 
(*! -*„) ~x 2 )~ (0.1746)(- 0.1745) 

- 32.8216(x 2 - 0.6981* + 0.0914). 
te-soHs-ah) _te-0.1745)te- 0.3491) 


' te 2 -* 0 )te 2 -ati) (0.3491)(-0.1745) 

= 16.4155(x 2 - 0.5236x + 0.0609). 

The Lagrange quadratic polynomial is given by 

P 2 (x) = l 0 (x) /te 0 ) + Ifx) fl Xl ) + l 2 (x) f{x 2 ) 

= 16.4061(x 2 - 0.8727* + 0.1828) (1.1585) - 32.8616 (x 2 - 0.6981* 

+ 0.0914) (1.2817) + 16.4155(x 2 - 0.5236* + 0.0609) (1.3660) 
= - 0.6374* 2 + 1.0394* + 0.9950. 
fl.n/12) = f{ 0.2618) = 1.2234. 

The exact value is /(0.2618) = sin(0.2618) + cos(0.2618) = 1.2247. 

Example 2.5 Construct the Lagrange interpolation polynomial for the data 


* 

-1 

1 

4 

7 

fix) 

-2 

0 

63 

342 


Hence, interpolate at * = 5. 

Solution The Lagrange fundamental polynomials are given by 

^ . s _ (* -*i)(* -* 2 )(* -* 3 ) _ (* -1)(* -4)(* -7) 

°* " (*o-x 1 )(*o-* 2 )(*o-^3) _ (-1-1)(-1-4)(-1-7) 
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= - ^ (x 3 - 12x 2 + 39x - 28). 

_ (x -x 0 )(x -x 2 )(x -x 3 ) _ (x +l)(x -4)(x -7) 
(xx -x 0 )(x 1 -X 2 )(X! -x 3 ) (1 + 1)(1-4)(1-7) 


= ^ (x 3 - 10x 2 + 11 x + 28). 

(x -x 0 )(x -x x )(x -x 3 ) _ (x +1)(x -1) (x -7) 

2% (x 2 -x 0 )(x 2 -x x )(x 2 -X 3 ) (4 + 1) (4-1) (4-7) 

= -i (x 3 -7x 2 -x + 7). 

45 

(x -x 0 )(x -x x )(x -x 2 ) _ (x + l)(x -l){x -4) 
( x 3 -x 0 )(x 3 -x 1 )(x 3 -x 2 )~ (7 +1)(7-1)(7-4) 


1 

144 


(x 3 - 4x 2 -x + A). 


Note that we need not compute l^x) since fix x ) = 0. 

The Lagrange interpolation polynomial is given by 

P 3 (x) = l 0 (x) flx 0 ) + ip) fix,) + l 2 (x) frx 2 ) + Ip) flx 3 ) 


p 

80 


(x 3 - 12x 2 + 39x - 28) (- 2) - 


45 


(x 3 -lx 2 -x + l) (63) 


1 

144 


(x 3 - 4x 2 -x + 4) (342) 


fjL_l 111^1 f p 49 17T) f 39 7 171') f p_49 171^ 
= v40 5 + 72 J x3 + V 10 + T l8^J x2 + t40 + 5 ^72j x + { 10 y + _ 8^J 
= x 3 - 1. 

Hence, fl 5) = P 3 (5) = 5 3 - 1 = 124. 


Remark 2 For a given data, it is possible to construct the Lagrange interpolation polynomial. 
However, it is very difficult and time consuming to collect and simplify the coefficients of x l , i 
= 0, 1, 2,..., n. Now, assume that we have determined the Lagrange interpolation polynomial 
of degree n based on the data values (x t , fix,)), i = 0, 1 , 2 ,..., n at the in + 1) distinct points. 
Suppose that to this given data, a new value (x n+1 , flx n+1 )) at the distinct point x n+1 is added at 
the end of the table. If we require the Lagrange interpolating polynomial for this new data, 
then we need to compute all the Lagrange fundamental polynomials again. The nth degree 
Lagrange polynomial obtained earlier is of no use. This is the disadvantage of the Lagrange 
interpolation. However, Lagrange interpolation is a fundamental result and is used in prov¬ 
ing many theoretical results of interpolation. 
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Remark 3 Suppose that the data (x, fixf), i = 0, 1, 2,..., n, is given. Assume that a new value 
(x n+ 1 , flx n+1 )) at the distinct point x n+1 is added at the end of the table. The data, (x t , f[xfi), 
i = 0, 1, 2,..., n + 1, represents a polynomial of degree < (n + 1). If this polynomial of degree 
(n + 1) can be obtained by adding an extra term to the previously obtained nth degree inter¬ 
polating polynomial, then the interpolating polynomial is said to have th epermanence property. 
We observe that the Lagrange interpolating polynomial does not have the permanence property. 

Divided differences 

Let the data, (x, flxf), i = 0, 1, 2,..., n, be given. We define the divided differences as follows. 
First divided difference Consider any two consecutive data values (x t , flxf), (x !+1 , flx i+1 )). Then, 
we define the first divided difference as 


Therefore, 


fix, x i+1 ] = 


ftx i+1 )-f(Xi) 
x i+ 1 - x t 


i = 0,1, 2 ,..., n - 1. 


fK = r^-r^\ nxv = fM-fM etc . 

x 1 -x 0 X 2 - Xl 


( 2 . 12 ) 


Note that fix, x i+ A = f[x i+v x £ ] = l l> + ' i+V . 

*i ~ x i+1 x i+1 - x t 

We say that the divided differences are symmetrical about their arguments. 

Second divided difference Consider any three consecutive data values (x, flxf), (x i+1 , f{x i+1 )), 
(x i+2 , fix i+2 )). Then, we define the second divided difference as 


f[XiXi + 


. flXj+l, X i+2 \ - f{x u x^ +1 ] 
X i+ 2 ~ X t 


1 = 0, 1 , 2 ,..., n - 2 


(2.13) 


etc. 

x 2 - Xq 


Therefore, 

We can express the divided differences in terms of the ordinates. We have 


f[x 0 , x v x 2 ] = --— T ^ ^ - f 1 ^° 1 

X 2 -X 0 lX 2 -X 0 Xi-XoJ 


fo 


r. 1 


(x Q - XjXXq - X 2 ) (x 2 -x 0 ) \_x 2 -x 1 X^ — Xq J (x 2 - x 0 )(x 2 - x x ) 


__ fo _ + _ fi _ + _ h _ 

(x 0 - XjXxq - x 2 ) (x 1 -x 0 )(x 1 -x 2 ) (x 2 — x 0 )(x 2 — xf) 

Notice that the denominators are same as the denominators of the Lagrange funda¬ 
mental polynomials. In general, we have the second divided difference as 

f\x,x ia ,*a = 
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fi 

(*i - Xi+l)(Xi - X i+ 2 ) 


(X i+1 ~ X L )(x i+1 - X i+2 ) (x i+2 ~ X t )(x i+2 ~ X i+1 ) 


The nth divided difference using all the data values in the table, is defined as 


f[x 0 , x v ..., x n \ = 


f[x 1 ,x 2 ,...,x n ]-f[x 0 ,x 1 ,...,x n _ 1] 


(2.14) 


The nth divided difference can also be expressed in terms of the ordinates f v The de¬ 
nominators of the terms are same as the denominators of the Lagrange fundamental polyno¬ 
mials. 


The divided differences can be written in a tabular form as in Table 2.1. 


Table 2.1. Divided differences (d.d). 


X 

f(x) 

First d.d 

Second d.d 

Third d.d 

x 0 

fo 

f\x 0 , Xl ] 



X 1 

fl 

f[x v x 2 ] 

f[x 0 , x v x 2 \ 

f[x Q , x v x 2 , x 3 ] 

x 2 

4 

fix2, X 3 ] 

f[x v x 2 , x 3 ] 


X 3 

4 





Example 2.6 Find the second divided difference of f(x) = llx, using the points a, b, c. 

Solution We have 


fla, b ] = 


fib, c ] = 


fib) -f{d) 
b -a 

fic) -fjb) 
c-b 


i ri ii a ~ b _ 1 

b-a\_b a] ib-a)ab ab 

i ri ii_ b-c _ i 

c-b\_c b\ ic-b)bc be’ 


fla, b, c] = 


fib, c] - fla, b] 
c-a 


1 r _i n_ c-a _ 1 

c-a\_ be ab\ ic-a)abc abc 


Example 2.7 Obtain the divided difference table for the data 


X 

-1 

0 

2 

3 

fix ) 

-8 

3 

1 

12 


(A. U Nov /Dec 2006) 
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Solution We have the following divided difference table for the data. 

Divided difference table. Example 2.7. 


X 

m 

First d.d 

Second d.d 

Third d.d 

-1 

-8 

s±i-n 

0+1 



0 

3 

^=-1 

2-0 

^ 11 =-4 

2 + 1 

4+^2 

3+1 

2 

1 

3-2 

H+ 1 _ 4 

3-0 ” 


3 

12 





2.2.2 Newton’s Divided Difference Interpolation 

We mentioned earlier that the interpolating polynomial representing a given data values is 
unique, but the polynomial can be represented in various forms. 

We write the interpolating polynomial as 
fix) = P n (x) 

= C 0 + (x -x 0 ) c 1 + (x - x 0 )(x - Xj) c 2 + ... + (x - x 0 )(x - Xjh.Xx - X n l ) C n . (2.15) 
The polynomial fits the data P n lxf) = fix) = f v 
Setting P n (x 0 ) = f 0 , we obtain 

p n ( x o> =fo = c o 

since all the remaining terms vanish. 

Setting P n lx x ) = f v we obtain 

f, = c 0 + (x. - x 0 ) c v or c. = ————— =f[x 0 , xJ. 

X!-X 0 X!-X 0 

Setting P n (x 2 ) = f 2 , we obtain 

f 2 = c 0 + (x 2 - c i + ( X 2 ~ X 0^ X 2 ~ *i) C 2> 
or c fj-fp- - *p) f{x 0» x li 

2 (x 2 - X 0 )(x 2 - x x ) 

= 7-J-7 \h -fo- (*2 - *o) 

(x 2 -x 0 )(x 2 -x-y) y ^x-l-XqJJ 












INTERPOLATION AND APPROXIMATION 


73 


__ fo _ + _ fi _ + _ [2 _ 

(x 0 - x^Ixq - x 2 ) (x 1 -x 0 )(x 1 -x 2 ) (x 2 -x 0 )(x 2 -Xj) 

= f[x 0 , X v X 2 ]. 

By induction, we can prove that 

C„ =/"[x0’ X l’ X 2> —> X J- 

Hence, we can write the interpolating polynomial as 
fix) = P n (x) 

= fix 0 ) + (x - X 0 ) f [x Q , X-,] + (x - x 0 )(x - Xj) f [x 0 , x v x 2 ] + ... 

+ (x - x 0 )(x - x a )...(x - X n _ x ) f [x 0 , x 1 . xj (2.16) 

This polynomial is called the Newton’s divided difference interpolating polynomial. 

Remark 4 From the divided difference table, we can determine the degree of the interpolat¬ 
ing polynomial. Suppose that all the kth. divided differences in the&th column are equal (same). 
Then, all the (k + l)th divided differences in the (k + l)th column are zeros. Therefore, from 
(2.16), we conclude that the data represents a kth degree polynomial. Otherwise, the data 
represents an nth degree polynomial. 

Remark 5 Newton’s divided difference interpolating polynomial possesses the permanence 
property. Suppose that we add a new data value (x n+1 , flx n+1 )') at the distinct point x n+] , at the 
end of the given table of values. This new data of values can be represented by a (n + l)th 
degree polynomial. Now, the (n + l)th column of the divided difference table contains the 
(n + l)th divided difference. Therefore, we require to add the term 

(x - x 0 )(x - xf)...{x - x n l )(x - x n ) f [x 0 , x v ., x n , x n+1 ] 

to the previously obtained nth degree interpolating polynomial given in (2.16). 

Example 2.8 Find f(x) as a polynomial in x for the following data by Newton’s divided differ¬ 
ence formula 


X 

-4 

- 1 

0 

2 

5 

fix) 

1245 

33 

5 

9 

1335 


{A. U Nov / Dec. 2004 ) 

Solution We form the divided difference table for the data. 

The Newton’s divided difference formula gives 

fix) = fix 0 ) + (x - x 0 ) f [x 0 , xj + (x - x 0 )(x - x-,) f [x 0 , x v x 2 ] 

+ (x - x 0 )(x - XjXx - x 2 f [x 0 , x v x 2 , x 3 ] 

+ (x - x 0 )(x - XjXx - x 2 )(x - x 3 ) f [x 0 , x v x 2 , x 3 , x 4 ] 
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= 1245 + (x + 4)(- 404) + (x + 4)(x + 1X94) + (x + 4)(x + 1) x (- 14) 
+ (x + 4)(x + 1) x (x - 2)(3) 

= 1245 - 404x - 1616 + (x 2 + 5x + 4)(94) + (x 3 + 5x 2 + 4x)(- 14) 

+ (x 4 + 3x 3 - 6x 2 - 8x)(3) 

= 3x 4 - 5x 3 + 6x 2 - 14x + 5. 


Divided difference table. Example 2.8. 


X 

fix) 

First d.d 

Second d.d 

Third d.d 

Fourth d.d 

-4 

1245 

-404 




- 1 

33 

-28 

94 

- 14 


0 

5 

2 

10 

13 

3 

2 

9 

442 

88 



5 

1335 






Example 2.9 Find f(x) as a polynomial in x for the following data by Newton’s divided differ¬ 
ence formula 


X 

-2 

- 1 

0 

1 

3 

4 

fix) 

9 

16 

17 

18 

44 

81 


Hence, interpolate at x = 0.5 andx = 3.1. 

Solution We form the divided difference table for the given data. 

Since, the fourth order differences are zeros, the data represents a third degree polyno¬ 
mial. Newton’s divided difference formula gives the polynomial as 

fix) = fix 0 ) + (x - X 0 ) f [x 0 , xj + (x - x 0 )(x - x x ) f [x 0 , x v x 2 ] 

+ (x - x 0 )(x - Xj) (x - x 2 ) f [x 0 , x v x 2 , x 3 ] 

= 9 + (x + 2X7) + (x + 2)(x + ix- 3) + (x + 2)(x + 1) x(l) 

= 9 + 7x + 14 - 3x 2 - 9x - 6 + x 3 + 3x 2 + 2x = x 3 + 17. 
f{0.5) = (0.5) 3 + 17 = 17.125. 

/(3.1) = (3.1) 3 + 17 = 47.791. 


Hence, 
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Divided difference table. Example 2.9. 


* 

f(x) 

First d.d 

Second d.d 

Third d.d 

Fourth d.d 

-2 

9 

7 




-1 

16 

1 

-3 

1 


0 

17 


0 


0 

1 

18 

13 

4 

1 

0 

3 

44 

37 

8 



4 

81 






Example 2.10 Find f(x) as a polynomial in x for the following data by Newton’s divided differ¬ 
ence formula 


X 

l 

3 

4 

5 

7 

10 

fix) 

3 

31 

69 

131 

351 

1011 


Hence, interpolate at x = 3.5 and x = 8.0. Also find, f\ 3) and f"( 1.5). 
Solution We form the divided difference table for the data. 


Divided difference table. Example 2.10. 



f(x) 

First d.d 

Second d.d 

Third d.d 

Fourth d.d 

1 

3 

14 




3 

31 

38 

8 

1 


4 

69 

62 

12 

1 

0 

5 

131 

110 

16 

1 

0 

7 

351 

220 

22 



10 

1011 






Since, the fourth order differences are zeros, the data represents a third degree 
polynomial. Newton’s divided difference formula gives the polynomial as 
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fix) = fix) + (x - x 0 ) f [x 0 , xj + (x - x 0 )(x - X-,) f [x 0 , x v x 2 ] 

+ (x - x 0 )(x - xfHx - x 2 ) f [x 0 , x v x 2 , X 3 ] 

= 3 + (x - 1)(14) + (x - l)(x - 3)(8) + (x - l)(x - 3)(x - 4)(1) 

= 3 + 14x - 14 + 8x 2 - 32x + 24 + x 3 - 8x 2 + 19x - 12 = x 3 + x + 1. 
Hence fi 3.5) « P 3 (3.5) = (3.5) 3 + 3.5 + 1 = 47.375, 

fl.8.0) » P 3 (8.0) = (8.0) 3 + 8.0 + 1 = 521.0. 

Now, F 3 (x) = 3x 2 + 1, and P" 3 (x) = 6x. 

Therefore, f'(3) » P'(3) = 3(9) + 1 = 28, f"(1.5) » P"(1.5) = 6(1.5) = 9. 

Inverse interpolation 

Suppose that a data (x p fix)), i = 0, 1, 2,..., n, is given. In interpolation, we predict the 
value of the ordinate fix') at a non-tabular point x = x'. In many applications, we require the 
value of the abscissa x' for a given value of the ordinate fix'). For this problem, we consider the 
given data as (fix), x), i = 0,1, 2,..., n and construct the interpolation polynomial. That is, we 
consider fix) as the independent variable and x as the dependent variable. This procedure is 
called inverse interpolation 


- ( REVIEW QUESTIONS ) - 

1. Give two uses of interpolating polynomials. 

Solution The first use is to reconstruct the function fix) when it is not given explicitly 
and only values of fix) and/ or its certain order derivatives are given at a set of distinct 
points called nodes or tabular points. The second use is to perform the required opera¬ 
tions which were intended for fix), like determination of roots, differentiation and inte¬ 
gration etc. can be carried out using the approximating polynomial P(x). The approxi¬ 
mating polynomial P(x) can be used to predict the value of fix) at a non-tabular point. 

2. Write the property satisfied by Lagrange fundamental polynomials Ifx). 

Solution The Lagrange fundamental polynomials Ifx) satisfy the property 

Ifx) = 0, i ±j 

= 1, i =j 

3. Write the expression for the bound on the error in Lagrange interpolation. 

Solution The bound for the error in Lagrange interpolation is given by 

I W,x) | = | (*-x 0 )(*-x 1 )...(*-x n ) | | f (n+1) © | 

<--— max |(x-x 0 )(x-x 1 )...(x-x )| max | f (n+1) (x)| 

(n + 1)! \[_a<,xzb J 

4. What is the disadvantage of Lagrange interpolation? 

Solution Assume that we have determined the Lagrange interpolation polynomial of degree 
n based on the data values (x p fix)), i = 0, 1 , 2 ,..., n given at the in + 1) distinct points. 
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Suppose that to this given data, a new value (x n+1 , fix n+1 )') at the distinct point x n+1 is 
added at the end of the table. If we require the Lagrange interpolating polynomial of 
degree (n + 1) for this new data, then we need to compute all the Lagrange fundamental 
polynomials again. The nth degree Lagrange polynomial obtained earlier is of no use. 
This is the disadvantage of the Lagrange interpolation. 

5. Define the permanence property of interpolating polynomials. 

Solution Suppose that a data (x., fix)), i = 0,1, 2,..., n, is given. Assume that a new 
value (x n+1 , fix n+ )) at the distinct point x n+1 is added at the end of the table. The data, 
ix p f{x)), i = 0, 1,2,..., n + 1, represents a polynomial of degree (n + 1). If this polynomial 
of degree (n + 1) can be obtained by adding an extra term to the previously obtained nth 
degree interpolating polynomial, then the interpolating polynomial is said to have the 
permanence property. 

6. Does the Lagrange interpolating polynomial have the permanence property? 

Solution Lagrange interpolating polynomial does not have the permanence property. 
Suppose that to the given data (x t , fix)), i = 0, 1, 2,..., n, a new value (x n+1 , fix n+1 )) at the 
distinct point x ra+1 is added at the end of the table. If we require the Lagrange interpolat¬ 
ing polynomial for this new data, then we need to compute all the Lagrange fundamen¬ 
tal polynomials again. The nth degree Lagrange polynomial obtained earlier is of no 
use. 

7. Does the Newton’s divided difference interpolating polynomial have the permanence 
property? 

Solution Newton’s divided difference interpolating polynomial has the permanence 
property. Suppose that to the given data (x p fix)), i = 0, 1, 2,..., n, a new data value (x n+1 , 
fix n+ 1)) at the distinct point x n+1 is added at the end of the table. Then, the in + l)th 
column of the divided difference table has the in + l)th divided difference. Hence, the 
data represents a polynomial of degree in + 1). We need to add only one extra term 
(x - x 0 )(x - x^.-Xx - x n ) f[x 0 , x v ... x n+1 ] to the previously obtained nth degree divided 
difference polynomial. 

8. Define inverse interpolation. 

Solution Suppose that a data (x., fix)), i = 0,1, 2. n, is given. In interpolation, we 

predict the value of the ordinate fix') at a non-tabular point x = x\ In many applications, 
we require the value of the abscissa x' for a given value of the ordinate fix'). For this 
problem, we consider the given data as (fix), x), i = 0, 1, 2 ,..., n and construct the 
interpolation polynomial. That is, we consider fix) as the independent variable and x as 
the dependent variable. This procedure is called inverse interpolation 

- ( EXERCISE 2.1 ) - 

1. Use the Lagrange’s formula to find the quadratic polynomial that takes these values 


x 0 1 3 

y oio 


Then, find fi 2). 


(A. U Nov / Dec. 2005) 
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2. Using Lagrange interpolation, find the unique polynomial P(x) of degree 2 or less such 
that P{ 1) = 1, P{ 3) = 27, P(4) = 64. 

3. A third degree polynomial passes through the points (0, - 1), (1, 1), (2, 1), and (3, 2). 
Determine this polynomial using Lagrange’s interpolation. Hence, find the value at 1.5. 

4. Using Lagrange interpolation, find y(10) given that 

y(5) = 12, y( 6) = 13, y(9) = 14, y(ll) = 16. 

5. Find the polynomial fix) by using Lagrange’s formula and hence find f{3) for 


X 

0 

1 

2 

5 

Ax) 

2 

3 

12 

147 


(A.UApr/May 2005) 

6. Using Lagrange’s method, fit a polynomial to the data 


- 12 


0 


12 


Also find y at x = 2. (A.U Nov / Dec. 2006) 

7. Using Lagrange interpolation, calculate the profit in the year 2000 from the following 
data. 


Year 

1997 

1999 

2001 

2002 

Profit in lakhs ofRs. 

43 

65 

159 

248 


(A. U Nov / Dec. 2004 ) 


8. Given the values 


X 

14 

17 

31 

35 

Ax) 

68.7 

64.0 

44.0 

39.1 


find A 27) by using Lagrange’s interpolation formula. 

(A.UMay/Jun 2006, Nov/Dec. 2006) 

9. From the given values, evaluate f{9) using Lagrange’s formula. 


* 

5 

7 

11 

13 

17 

Ax) 

150 

392 

1452 

2366 

5202 


(A.UNov/Dec. 2003) 


10. From the given values, evaluate A 3) using Lagrange’s formula. 



- 1 

2 

4 

5 

Ax) 

-5 

13 

255 

625 
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11. Find the missing term in the table using Lagrange’s interpolation 


0 12 3 4 


y 1 3 9 - 81 

12. Obtain the root of fix) = 0 by Lagrange’s interpolation given that 

/(30) = - 30, fi 34) = - 13, fl 38) = 3, fi 42) = 18. (A. U Nov /Dec. 2004) 

13. Using the Lagrange interpolation with the truncation error, show that the Lagrange 
interpolation polynomial for fix) = x n+1 at the points x Q , x v ..., x n is given by x n+1 - (x - 
x Q )(x - x-f)...(x - x n ). 


14. Show that 


bd 


1 

abed 


{A.UNov/Dec. 2004) 


15. If fix) = 1/x 2 , find the divided difference f[x v x 2 , x 3 , x 4 ]. 

16. Calculate the nth divided difference of 1/x, based on the points x Q , x v x 2 ,..., x n 

17. Using Newton’s divided difference formula, determine fl 3) for the data 


X 

0 

1 

2 

4 

5 

fix) 

1 

14 

15 

5 

6 


18. Using Newton’s divided difference interpolation, find y(10) given that 

y(5) = 12, y(6) = 13, y(9) = 14, y(ll) = 16. 

19. Using divided difference formula, find u{ 3) given 

u( 1) = - 26, u{ 2) = 12, u( 4) = 256, and n(6) = 844. (A.U Nov /Dec. 2004) 

20. Find fl 8) by Newton’s divided difference formula, for the data 


X 

4 

5 

7 

10 

11 

13 

fix) 

48 

100 

294 

900 

1210 

2028 


IA.UApr/May 2005) 

21. Using Newton’s divided difference method, find /(1.5) using the data 
/U.0) = 0.7651977,/(1.3) = 0.6200860, /(1.6) = 0.4554022, 

/(1.9) = 0.2818186, and fl 2.2) = 0.1103623. IA.U Nov/Dec. 2005) 


22. From the given values, evaluate fl 3) using Newton’s divided difference formula. 


X 

- 1 

2 

4 

5 

fix) 

-5 

13 

255 

625 
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2.3 INTERPOLATION WITH EVENLY SPACED POINTS 

Let the data (x t , fa)) be given with uniform spacing, that is, the nodal points are given by 
x- = x 0 + ih, i = 0, 1, 2, ..., n. In this case, Lagrange and divided difference interpolation 
polynomials can also be used for interpolation. However, we can derive simpler interpolation 
formulas for the uniform mesh case. We define finite difference operators and finite differences 
to derive these formulas. 

Finite difference operators and finite differences 

We define the following five difference operators. 

Shift operator E When the operator E is applied on fix), we obtain 

Efa) = fa t + h) = fa i+1 ). (2.17) 

That is, Ef[x 0 ) = f{x 0 + h) = fix,), Efa,) = fa, + h) = fa 2 ), etc. 

Therefore, the operator E when applied on/(x) shifts it to the value at the next nodal point. We 
have 

E 2 fa) = E[Efa)l = E[f{x i + h)] = fix, + 2 h) = flx i+2 ). 

In general, we have 

E k fix) = fa. + kh) = fa i+k ) (2.18) 

where k is any real number. For example, we define 

E V2 f{x i ) = f[x i + } ^ = f{x i+V2 ). 

Forward difference operator A When the operator A is applied on flxf), we obtain 

A fa.) = fa. + h)~ flxf = f i+1 - f.. (2.19) 

That is, A fa 0 ) = flx 0 + h) - f{x 0 ) = flxf - fa 0 ), 

A faf) = fa 1 + h)~ faf) = fa 2 ) - fix,), etc. 

These differences are called the first forward differences. 

The second forward difference is defined by 

A 2 fix,) = A[A flxf}] = A | fa t + h) - flxf] = A fix, + h) - A faf) 

= \fa t + 2 h) - fa. + h)\ - \fa t + h)~ fa.)\ 

= fix, + 2 h) - 2/(x. + h) + fa) = f i+2 - 2 f i+1 + f.. 

The third forward difference is defined by 

A 3 fix,) = A [A 2 fa)\ = A fix, + 2 h) - 2A fix, + h) + A fa.) 

= 43-342 + 3^-4 

Now, from (2.18) and (2.19), we get 

A fa) = fa t + h) -fa) =Ef i -f i = {E- 1)4 
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Comparing, we obtain the operator relation 

A = E - 1, or E = 1 + A. (2.20) 

Using this relation, we can write the nth forward difference of fix) as 


A" fix,) = (E-l) n fix) = X ( - 1)k k l (n~ k) \ fi+n ~ k ' ( 2 - 21 ) 

The forward differences can be written in a tabular form as in Table 2.2. 

Table 2.2. Forward differences. 



Backward difference operator V When the operator V is applied on fix), we obtain 

V fix) = fix) - fix t -h) = f i - f_ r (2.22) 

That is, Wfix 1 )=fix 1 )-fix 0 ), 

V f{x 2 ) = fix 2 ) - fixf, etc. 

These differences are called the first backward differences. 

The second backward difference is defined by 

V 2 fixf = V[V flxf] = W-xf - fix, -h)] = V fixf -V fix,- h ) 

= flxf - fix, - h)] - [fix, -h)- fix, - 2 h)\ 

= fix .) - 2flx, -h) + fix, - 2 h) =f,~ 2f,_ x + f_ 2 
The third backward difference is defined by 

V 3 fix) = V[V 2 fix)] = V fix) - 2V fix, -h) + V fix 2 h) 

= fi- ZfiXl + Wi-2-ft-V 
Now, from (2.18) and (2.22), we get 

V fix) = fix) - fix, -h) = f i - E- 1 f = il- E-%. 

Comparing, we obtain the operator relation 

V = 1 -Er l , or Er 1 = 1 - V, or E = (1 - V)- 1 . 


(2.23) 
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Using this relation, we can write the nth backward difference of fixf as 

V" fa) = (1 - E-'Tfe.) = Y (-1)* ]f nl fi- k (2.24) 

k = o 

The backward differences can be written in a tabular form as in Table 2.3. 


Table 2.3. Backward differences. 



Remark 6 From the difference tables 2.2, 2.3, we note that the numbers (values of differ¬ 
ences) in all the columns in the two tables are same. We identify these numbers as the re¬ 
quired forward or backward difference. For example, from the columns of the table, we have 

A/o = V/i, A f % = W 2 , A f 2 = Vf 3 , ..., A% = V%. 

Example 2.11 Construct the forward difference table for the data 


% 

-1 

0 

1 

2 

f(x) 

-8 

3 

1 

12 


Solution We have the following difference table. 


Forward difference table. Example 2.11 
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Example 2.12 Construct the backward difference table for the data 


* 

-1 

0 

1 

2 

fix) 

-8 

3 

1 

12 


Solution We have the following difference table. 

Backward difference table. Example 2.12. 



Central difference operator 8 When the operator 8 is applied on fix), we obtain 

8 fix) = (* f + |] - f (*i - |] = fi + 1/2 - fi- 1 / 2 - (2.25) 

We note that the ordinates on the right hand side of (2.25) are not the data values. These 
differences are called the first central differences. Alternately, we can define the first central 
differences as 

S f f*i += S fi+ 1/2 = f (x i +h) ~ f( x i ) = fui - fi • (2.26) 

That is, 8 f V2 =f\- f 0 , 8 f m = f 2 ~ f v etc. The ordinates on the right hand side of (2.26) are the 
data values. 

The second central difference is defined by 

S 2 fix,) = 8[8 fix,)) = 8 | f i+y2 - f\_ m \ = 8 f i+y2 - bf_ 1/2 
= \f i+1 ~ ft ~\fi~ fft = f i+1 ~ 2 f + f_ v 

The third central difference is defined by 

8 3 fix) = 8 [ 8 2 fix) ] = 8 f l+1 - 28 f + 8 

= ifi+3/2 - fi+lft - 2 ifi+V2 ~ fi-lft + ifi- 1/2 _ f :-3/2) 

= f i+3/2 _ 3f - +1/2 + 3 f -_ V2 - f ;_ 3/2 . 

All the odd central differences contain non-nodal values and the even central differences contain 
nodal values. 
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Now, from (2.18) and (2.25), we get 

5 /fr|) = fuv2- fi-1/2 = Em fi - E ~ m fl = - E ~ V ^ fi- 

Comparing, we obtain the operator relation 

5 = (E V2 - E~ m ). (2.27) 

Using this relation, we can write the nth central difference of f[x^ as 

5- fix} = (8“-^ fix} = E <- 1)‘ Y ,< 2 - 2s > 

The central differences can be written in a tabular form as in Table 2.4. 

Table 2.4. Central differences. 



Very often, we may denote the reference point as x Q and the previous points as x_ v x_ 2 , 
... and the later points as x v x 2 , .... Then, the central difference table can be written as in 
Table 2.5. Note that all the differences of even order lie on the same line as the abscissa and 
the ordinate. 

Remark 7 We show that A n f i = V n f i+n = 8 n f i+(n/2 y 

We have V = 1 - E~ x = (S' - 1) E~ x = A Er\ 

V% +n = A n E~ n f i+n = A% 

5 = (E m - E~ V2 ) = (E- 1) E~ m = A E~ V2 - 
V'fi + (n,2 ) =A- nE - n,2 fMn,2 ) =* n fi- 

Remark 8 Let P n (x) = a { p n + a ^" -1 + a^x. n ~ 2 + ... + a n be a polynomial of degree n. Then, 

A* P n (x) = 0, for k>n, and V k P n (x) = 0, for k> n, 

= a 0 (n !), for k = n = a 0 ( n !), for k = n. 
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Table 2.5. Central differences. 



Remark 9 For well behaved functions, the forward differences, backward differences and 
central differences decrease in magnitude along each column. That is, the second difference is 
smaller in magnitude than the first difference, the third difference is smaller in magnitude 
than second difference etc. 


Mean operator p When the operator |i is applied on flx t ), we obtain 

ti Kx t ) = ![/{*, + !)+/(*< - !)] = \[fi> 1/2 + fi-v 2 
Comparing, we have the operator relation 

p = ^[E m + E- m \. 

Example 2.13 Compute A 3 (l - 2 x)(l - 3x)(l - 4x). 


E- V2 ]fi 


(2.29) 


Solution We have 

A 3 (l - 2x)(l - 3x)(l - 4x) = A 3 (- 24x 3 + lower order terms) 

= - 24 (3 !) = - 144 

since A 3 (polynomial of degree 2 and less) = 0. 

Example 2.14 Construct the forward difference table for the sequence of values 
f( 0 , 0 , 0, e, 0, 0, 0) 

where e is the magnitude of the error in one ordinate value and all other ordinates are exact. 
Show that the errors propagate and increase in magnitude and that the errors in each column 
are binomial coefficients. 

Solution We have the following difference table. From the table, it can be observed that the 
errors propagate and increase in magnitude and that the errors in each column are binomial 
coefficients. 
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Forward difference table. Example 2.15. 


fix) 

A f 

A 2 f 

A 3 f 

A *f 

A 5 f 

A 6 f 

0 

0 






0 

0 

0 

e 




0 

e 

e 

- 3e 

- 4 e 

10 e 


e 

- e 

- 2e 

3e 

6 e 

-lOe 

- 20 e 

0 

0 

e 

-e 

- 4e 



0 

0 

0 





0 








Example 2.15 Prove the following. 


a) 5 = va - v)~ V2 (u)[i= 1 +^- 


(iii) A (f?) = (f. + f i+1 ) A f. 


(in) A (M.)- fMWM-fMAg(x) 

\ g(x) J gfxj gfx + h) 


Solution 

(i) V(1 - V)- 1/2 = (1 - E- 1 ) [1 - (1 - E- l )Y m 

= (1 - E~ 1 )E y2 = E m - E~ V2 = 5. 
Hi) S 2 = (E V2 - E~ V2 ) 2 = E+E~ 1 - 2. 


(iti) 

(fc) 



^l+|(E + E‘ 1 -2)j 

\[E + E- 1 + 2] 1/2 = | [£;i/ 2 + E~ 1/2 ] = |T. 


a (/; 2 ) = fl i - f?=(f i+ 1+/i)(/i + i - /;)=(/i + i+/;•) 

' /(x) ^ _ fix + ft) /(x) fix + ft)g(x) - /-(x)g(x + h) 
gix) J g(x + h) g{x) 


g(x)g(x + h ) 
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= g(x)[f(x + h)~ fix)] - f(x)[g(x + h)~ g(x)] 

g(x)g(x + h) 

_ g(x)Af(x) - fix) Ag(x) 
g(x)g(x + h) 

Relations between differences and derivatives 

We write Efix) as 

Efix) = fix + K) — fix) + hf'(x) + f\x) + ... 


1 h 2 D 2 1 

= 1+ hD + —^— +... flx) = e hD f(x). 

where D r f(x) = d r ft dx r , r = 1, 2, ... 

Hence, we obtain the operator relation 

E = e hD or hD = ln(E). (2.30) 

In terms of the forward, backward and central differences, we obtain 

hD = ln(£) = ln(l+ A) = A - - A 2 + - A 3 -... (2.31) 

2 3 

hD = ln(S) = ln(l - V ) -1 = - ln(l - V) = V + - V 2 + - V 3 +... (2.32) 

2 3 

Also, 8 = E 112 - E~ m = e hD/2 - e~ hDI2 = 2 sinh (hD/ 2). (2.33) 

Hence, hD = 2 sinh - 1 (5/2) and h 2 D 2 = 4 [sinh - 1 (5/2)] 2 . (2.34) 

Using the Taylor series expansions, we get 

A fix) = fix + h)- f(x) 


= jVo*;) + hf' (x) + f"(x) + ...j - f(x) = hf'(x) + f"(x) + ... 

Neglecting the higher order terms, we get the approximation 

A fix) = hf'(x), or f'(x)~^-Af(x). (2.35) 

h 

The error term is given by 

f'(x)-~Af(x) = -^f"(x) + ... 
h 2 

Hence, we call the approximation given in (2.35) as a first order approximation or of order 
0(h). 
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A 2 fix) = fix + 2A) - 2 fix + A) + fix) 

= I fix) + 2 hf'ix) + f"(x) + f"'(x) + 


- 2 | fix) + hf'ix ) + f"ix) + /'"(x) +... | + fix) 


= h 2 fix) + AY'%) + ... 

Neglecting the higher order terms, we get the approximation 


The error term is given by 


Hence, we call the approximation given in (2.36) as a first order approximation or of 
order 0(A). 

Similarly, we have the following results for backward differences. 

(2.37) 

(2.38) 
n 

For the central differences, we obtain 


= I m +| f\x) + fix) +^ fix) +.. 


- | fix) - | f'ix) + ^ /-"(X) - ^ /-'"(X) + .. 


Neglecting the higher order terms, we get the approximation 


The error term is given by 


f'ix)-^8fix) = -^-f'"ix) + ... 
A 24 


(2.39) 
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Hence, we call the approximation given in (2.39) as a second order approximation or of 
order 0{h 2 ). 

We have 5 2 fix) = fix + h) - 2 fix) + fix - h) 


fix) + hf'ix) + f" (x) * ,.,J -2 fix) + [, fix) - hf'ix) + ~f"ix)~... 

Neglecting the higher order terms, we get the approximation 

S 2 fix) ~h 2 f "ix), or f " ix) « -4 5 2 fix). (2.40) 

h 

The error term is given by 

f"ix) - 4 8 2 /(x) = - 7 — /‘ (iu) (*) + ... 
h. 12 

Hence, we call the approximation given in (2.35) as a second order approximation or of 
order Oih 2 ). 

Note that the central differences give approximations of higher order because of sym¬ 
metry of the arguments. 

The divided differences are also related to forward differences and backward differences. 

In the uniform mesh case, the divided differences can be written as 


f[Xi,X i+1 ] 


fix i+1 )-fiXi) = 1 A 1 
x i+ 1 — Xj h 1 h 1 


f[Xi, x i+1 , x i+2 ] 


f[x i+ 1 , x i+2 ] - /-[^, ^ +1 ] (l/A)4/f +1 - jyh)Afi 


2 ! h 2 A fi 2 ! h 2 V ^ +2 ‘ 

By induction we can prove that the nth divided difference can be written as 


2.3.1 Newton’s Forward Difference Interpolation Formula 

Let h be the step length in the given data. 

In terms of the divided differences, we have the interpolation formula as 

fix) = fix 0 ) + ix - x 0 ) f[x 0 , xj + ix - x 0 )(x - x x ) f[x 0 , x v x 2 ] + ... 
Using the relations for the divided differences given in (2.36) 

f[x 0 ,x 1 ,...,xj = — 1 Arr An fo 
n ! h 
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fix) = fix Q ) + (x- x 0 ) (x - x 0 )(x - Xj) 


+ (x- x 0 )(x - x x )...(x - X n l ) 


A n f 0 
1 \h n 


This relation is called the Newton’s forward difference interpolation formula. 
Suppose that we want to interpolate near the point x 0 . Set x = x 0 + sh. Then, 
x — x t = x 0 + sh — (x Q + ih) = (s — i)h. 

Therefore, x -x 0 = sh, x - x 1 = is - 1 )h, x - x 2 = is - 2 )h, etc. 
Substituting in (2.42), we obtain 
fix) = fix 0 + sh) 

sip-1) 2r , , s(s-l)(s-2)...(s-ra + l) 


= fix 0 ) + sAf 0 + - 


2! 


- A^o + 


AVo 


(2.43) 


We note that the coefficients are the binomial coefficients sCq , .S’C] sC n . 

Hence, we can write the formula (2.43) as 
fix) = fix 0 + sh) 

= sC 0 /(x 0 ) + sC 1 Af 0 + sC 2 A 2 f 0 + ... + sC n A n f 0 
Note that s = [(x - x 0 )/h\ > 0. 

This is an alternate form of the Newton’s forward difference interpolation formula. 

Error of interpolation The error of interpolation is same as in the Lagrange interpolation. 
Therefore, error of interpolation is given by 

_ (x - x 0 )(x - x x )...(x - x„) , 
in + 1)! ; 


EJf x) = - 


> © 


s(s-l)(s-2)..(s-n) 


h n+ 1 f (n+1) (^) = sC n+1 h n+1 f (n+1 \^) 


(2.44) 


(n +1)! 

where 0 < ^ < n. The coefficient in the error expression is the next binomial coefficient sC n+r 
Remark 10 The Newton’s forward difference formula has the permanence property. Suppose 
we add a new data value ix n+v f(x n+1 )) at the end of the given table of values. Then, the 
in + l)th column of the forward difference table has the in + l)th forward difference. Then, the 
Newton’s forward difference formula becomes 

fix) = fix 0 ) + (x - X 0 ) + (x - x 0 )(x - xf) 2^2 ** *" 


A n+1 fo 


+ (x - x 0 )(x - X x )...(x - X n ) 


in + 1)! h 1 
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Example 2.16 Derive the Newton’s forward difference formula using the operator relations. 

Solution We have 

fix 0 + sh ) = E° f{x 0 ) = (1 + A) s /(*„). 

Symbolically, expanding the right hand side, we obtain 

f[x 0 + sh) = ( sC 0 + sC 1 A + sC 2 A 2 + ...) f{x 0 ) 

= sC 0 f[x 0 ) + sC 1 A/fa 0 ) + sC 2 A 2 f[x 0 ) + ... + sC n A n fix 0 ) + ... 

We neglect the (n + l)th and higher order differences to obtain the Newton’s forward 
difference formula as 

f{x 0 + sh) = (sC 0 + sC 1 A + sC 2 A 2 + ...) f{x 0 ) 

= sC 0 f{x 0 ) + sC^flx^ + sC 2 A 2 f[x Q ) + ... + sC n A n f{x 0 ). 

Example 2.17 For the data 



-2 

- 1 

0 

1 

2 

3 

f(x) 

15 

5 

1 

3 

11 

25 


construct the forward difference formula. Hence, find f (0.5). 
Solution We have the following forward difference table. 

Forward difference table. Example 2.17. 



From the table, we conclude that the data represents a quadratic polynomial. We have 
h = 1. The Newton’s forward difference formula is given by 
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= 15 + (x + 2)(- 10) + (x + 2) (x + 1) UJ 

= 15 - 10* - 20 + 3x 2 + 9x + 6 = 3x 2 -x + 1. 
We obtain /(0.5) = 3(0.5) 2 - 0.5 + 1 = 0.75 - 0.5 + 1 = 1.25. 


2.3.2 Newton’s Backward Difference Interpolation Formula 

Again, we use the Newton’s divided difference interpolation polynomial to derive the Newton’s 
backward difference interpolation formula. Since, the divided differences are symmetric with 
respect to their arguments, we write the arguments of the divided differences in the order 
x n> x n- 1 >—> x v *0- r ^ ie Newton’s divided difference interpolation polynomial can be written as 
fix) = f[x n ) + (x - x n ) f[x n , x n l \ + (x - x n )(x - x n ,) f[x n , x n l , x n 2 \ + ... 

+ (x - x n )(x - x n l ) ... (x - xf) f[x n , x n V ..., Xq] (2.45) 

Since, the divided differences are symmetric with respect to their arguments, we have 

f[x n , Vil = fK-v X J = \ 

f[x n , X J, x 2 ] = f[x 2 , X v x \ = 1 V 2 f n , 

2! h 

fix , X n _ v ..., X 0 ] = flx 0 , x v ..., X n ] = —V" f n . 

n\h 

Substituting in (2.45), we obtain the Newton’s backward difference interpolation formula as 
fix) = f{x n ) + (x-x n ) j^-V/-(x„)+(x-x„)(x-x„_ 1 ) V 2 f{x n ) +... 

+ (x - x„)(x - x n-1 ) ... (x - xf) —— V n fix n ). (2.46) 

n ! h n 

Let x be any point near x n . Let x - x n = sh. Then, 

x - x t = x - x n + x n - x t = x - x n + (x 0 + nh) - (x 0 + ih) 

= sh + h(n -i) = (s + n- i)h, i = n - 1, n - 2, ..., 0. 

Therefore, x-x n = sh,x-x nl = (s + 1 )h, x - x n2 = (s + 2 )h, ..., x - x 1 = (s + n- 1 )h. 

Substituting in (2.46), we obtain the formula as 

sis + 1) 

fix) = fix n + sh) = fix n ) + sVfix n ) + 2 , V 2 fix n ) + ... 


s + l)(s + 2)... (s + n - 1) 


V n fix n ). 


(2.47) 
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Note that s = [(x - x n )/h\ < 0. The magnitudes of the successive terms on the right hand 
side become smaller and smaller. Note that the coefficients are the binomial coefficients 
[(- l) k (- s)CJ. 

Error of interpolation The expression for the error becomes 


E n (f x) = 


C x - x n )(x - X n _-f) ... (x - Xp) (n+ 1) 
(n + 1)! ' 


© 


. *»+lX» + 2>-<» + '»> f («» (?) (2.48) 

(n +1)! 

where 0 < Z, < n. 

Remark 11 As in divided differences, given a table of values, we can determine the degree of 
the forward/ backward difference polynomial using the difference table. The Mh column of the 
difference table contains the Mh forward/ backward differences. If the values of these differ¬ 
ences are same, then the ( k + l)th and higher order differences are zero. Hence, the given data 
represents a Mh degree polynomial. 

Remark 12 We use the forward difference interpolation when we want to interpolate near 
the top of the table and backward difference interpolation when we want to interpolate near 
the bottom of the table. 


Example 2.18 Derive the Newton’s backward difference formula using the operator relations. 
Solution Let x =x n + sh. Then, s = [(x - x n )/h\ < 0 

We have f{x n + sh) = E s fix n ) = (1 - V)- 5 f{x n ) 

Symbolically, expanding the right hand side, we obtain 

fix n + sh) = flx n ) + sVf{x n ) + V 2 f{x n ) + ... + S(S+1) '" ( , S + ra ~ i:> V n f{x n ) + ... 

1 1 2 ! 1 n ! 

We neglect the (n + l)th and higher order differences to obtain the Newton’s backward 
difference formula as 


flx n + sh) = flx n ) + sVfix n ) + V 2 f[x n ) + ... 


s(s+ 1)... (s + n - 1) 


V n f(x n ). 


Example 2.19 For the following data, calculate the differences and obtain the Newton’s 
forward and backward difference interpolation polynomials. Are these polynomials different ? 
Interpolate at x = 0.25 and x = 0.35. 



0.1 

0.2 

0.3 

0.4 

0.5 

f(x) 

1.40 

1.56 

1.76 

2.00 

2.28 


Solution The step length is h = 0.1. We have the following difference table. 

Since, the third and higher order differences are zero, the data represents a quadratic 
polynomial. The third column represents the first forward/ backward differences and the fourth 
column represents the second forward/ backward differences. 
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The forward difference polynomial is given by 


fix) = fix 0 ) + (x- X 0 ) ^ + (x - X 0 ) (x - x x ) 


( 0.04 A 


= 2x 2 + x + 1.28. 

The backward difference polynomial is given by 


fix) = fix n ) + ix - x n ) + ix-x n )ix - x n _x) ““t - 


= 2.28 + fa - 0.5) + fa - 0.5)fa - 0.4) 


= 2x 2 + x + 1.28. 

Both the poljmomials are identical, since the interpolation polynomial is unique. We obtain 
/(0.25) = 2(0.25) 2 + 0.25 + 1.28 = 1.655 
fi0.35) = 2(0.35) 2 + (0.35) + 1.28 = 1.875. 


Difference table. Example 2.19. 



Example 2.20 Using Newton’s backward difference interpolation, interpolate at x = 1.0 from 
the following data. 


X 

0.1 

0.3 

0.5 

0.7 

0.9 

1.1 

fix) 

- 1.699 

- 1.073 

- 0.375 

0.443 

1.429 

2.631 


Solution The step length is h = 0.2. We have the difference table as given below. 
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Since the fourth and higher order differences are zero, the data represents a third de¬ 
gree polynomial. The Newton’s backward difference interpolation polynomial is given by 

fix) = fix) + (x-x) - 1 - V fix) + (x- x)(x - x n J • J- V 2 fix) 
l\h n n 2 \h 

+ (x - x )(x - x .)(x - x 2 ) —V 3 f{x n ) 

„ n-1 n -2 3lh s 


= 2.631 + (x - 1.1) 


1202 ^1 

. 0.2 J 


+ (x - l.l)(x - 0.9) 


0.216 ^ 
.2(0.04) J 


f 0.048 ) 

+ (x-l.D(x-0. 9 )(x-0.7)[^^J 

= 2.631 + 6.01(x - 1.1) + 2.7(x - l.l)(x - 0.9) + (x - l.l)(x - 0.9)(x - 0.7) 
Since, we have not been asked to find the interpolation polynomial, we may not sim¬ 
plify this expression. At x = 1.0, we obtain 

/U.0) = 2.631 + 6.01(1.0 - 1.1) + 2.7(1.0 - 1.1X1.0 - 0.9) + (1.0 - 1.1X1.0 - 0.9X1.0 - 0.7) 
= 2.631 + 6.01(- 0.1) + 2.7(- 0.1X0.1) + (- 0.1)(0.1)(- 0.3) = 2.004. 


Difference table. Example 2.20. 



1. Write the expression for the derivative operator D in terms of the forward difference 
operator A 

Solution The required expression is 


hD = ln(£) = ln(l + A) = A - - A 2 + - A 3 - ... 
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or D=iln(£)=iln(l + A)=i[A-|4 2 + |A»-...] 

2. Write the expression for the derivative operator D in terms of the backward difference 
operator V. 

Solution The required expression is 


hD = In (E) = ln(l - V)- 1 = - ln(l - V) = V + | V 2 + | V 3 + ... 

„r D =l‘ n (E) 4 in< 1 - v ^ 1 =-i i '‘ ( 1 - v, 4[ v 4 v2 4 v8+ 4 

3. What is the order of the approximation f'(x) « t 1 A fix) ? 

h 


Hence, it is a first order approximation or of order 0(h). 


Hence, it is a first order approximation or of order 0(h). 

5. What is the order of the approximation f"( x ) ~ 5 2 fix) ? 

h z 


1 h 2 

Solution The error term is given by f"( x ) -~^8 2 f(x) = - f Hv> (x) +... 

h 12 

Hence, it is a second order approximation or of order 0(h 2 ). 

6. Give the relation between the divided differences and forward or backward differences. 
Solution The required relation is 

fix o, * 1; .A" f 0 = V" f n . 

n\h n\h 

7. Does the Newton’s forward difference formula has permanence property ? 

Solution Yes. The Newton’s forward difference formula has permanence property. 
Suppose we add a new data value (x n+v f(x n+1 )) at the end of the given table of values. 
Then, the In + l)th column of the forward difference table has the (n + l)th forward 
difference. Then, the Newton’s forward difference formula becomes 
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fhc) = fix 0 ) + (x - X 0 ) + (x- x 0 )(x - x{) 


+ (x - x 0 )(x - X-,) ... (x - X n ) - 


Vo 


(»+!}! h n+1 

8. For performing interpolation for a given data, when do we use the Newton’s forward 
and backward difference formulas? 

Solution We use the forward difference interpolation when we want to interpolate 
near the top of the table and backward difference interpolation when we want to 
interpolate near the bottom of the table. 

9. Can we decide the degree of the polynomial that a data represents by writing the forward 
or backward difference tables? 

Solution Given a table of values, we can determine the degree of the forward/ backward 
difference polynomial using the difference table. The &th column of the difference table 
contains the &th forward/ backward differences. If the values of these differences are 
same, then the (k + l)th and higher order differences are zero. Hence, the given data 
represents a &th degree polynomial. 

10. If x = x 0 + sh, write the error expression in the Newton’s forward difference formula. 
Solution The error expression is given by 


E n (f x) = 


- l)(s - 2)..(s - 

(n+D! 


ri) , 


1 f (n+1) (& = sC n+1 h n+ Y n+1) <&. 0 <^<n. 


11. If x = x n + sh, write the error expression in the Newton’s backward difference formula. 
Solution The error expression is given by 

p l)(s + 2).,(s + n) l 
in + 1)! 


E n (f, x) = 


- h n+1 f {n+1) ©. 0 < ^ < n. 


1. Prove the following. 

(0 A f 


VJ 


A fj 
fif i+ 1 


(iv) A-V = — A V. 

(iv) (1 + A)(l - V) = 1. 


EXERCISE 2. 




(v) n§ = (A + V)/2. 
(vii) 8 = VE V2 . 


m X A 2 fk = tf n+ i-tfo. 


(vim Vl + 8 2 p 2 = 1 + (1/2)5 2 . 


2. Using the Newton’s forward difference formula, find the polynomial fix) satisfying the 
following data. Hence, evaluate y at x = 5. 


(A.U. May/Jun 2006) 
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3. A third degree polynomial passes through the points (0, - 1), (1, 1), (2, 1) and (3, - 2). 
Determine this polynomial using Newton’s forward interpolation formula. Hence, find 
the value at 1.5. 

4. Using the Newton’s forward interpolation formula, find the cubic polynomial which 
takes the following values. 


0 12 3 


y 1 2 1 10 

Evaluate y(4) using Newton’s backward interpolation formula. Is it the same as ob¬ 
tained from the cubic polynomial found above? 

5. Obtain the interpolating quadratic polynomial for the given data by using the Newton’s 
forward difference formula 



(At/. Nov I Dec 2003) 

6. For the following data, estimate the number of persons earning weekly wages between 
60 and 70 rupees. 


Wage (in Rs.) 

below 40 

40-60 

60-80 

80-100 

100-120 

No. of persons 
(in thousands) 

250 

120 

100 

70 

50 


(At/. Nov /Dec 2003) 


7. Using the Newton’s backward interpolation formula construct an interpolation polyno¬ 
mial of degree 3 for the data 

/(- 0.75) = - 0.07181250,/(- 0.5) = - 0.024750,/(- 0.25) = 0.33493750,/(0) = 1.1010. 
Hence, find /(- 1/3). (A U. Apr /May 2003) 

8. Using the Newton’s forward difference formula, find the polynomial f(x) satisfying the 
following data. Hence, find /(2). 


y 


o 


5 


10 


15 


14 


379 


1444 


3584 


9. The following data represents the function fix) - e x . 


(. A.U. Apr /May 2004) 


y 


1 1.5 2.0 2.5 


2.7183 


4.4817 


7.3891 


12.1825 
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Estimate the value of f2.25) using the (i) Newton’s forward difference interpolation 
and (ii) Newton’s backward difference interpolation. Compare with the exact value. 
10. The following data represents the function fix) = cos (x + 1). 


X 

0.0 

0.2 

0.4 

0.6 

fix) 

0.5403 

0.3624 

0.1700 

- 0.0292 


Estimate the value of/(0.5) using the Newton’s backward difference interpolation. Com¬ 
pare with the exact value. 

11. The following data are part of a table for/(x) = cosx/x, where x is in radians. 


X 

0.1 

0.2 

0.3 

0.4 

fix) 

9.9500 

4.9003 

3.1845 

2.3027 


Calculate fi 0.12), (i) by interpolating directly from the table, (ii) by first tabulating x 
fix) and then interpolating from the table. Explain the difference between the results. 


2.4 SPLINE INTERPOLATION AND CUBIC SPLINES 

In the earlier days of development of engineering devices, the draftsman used a device to 
draw smooth curves through a given sets of points such that the slope and curvature are also 
continuous along the curves, that is, fix), fix) and f'Xx) are continuous on the curves. Such a 
device was called a spline and plotting of the curve was called spline fitting. 

We now define a spline. 

Let the given interval [a, b ] be subdivided into n subintervals [x 0 , xj, [x 1 , x 2 ], ..., 
[x n _ i, x n ] where a =x 0 <x 1 <x 2 < ... <x n = b. The points x 0 , x 1 , ..., x n are called nodes or knots and 
x 1 , ..., x n l are called internal nodes. 

Spline function A spline function of degree n with nodes x 0 , x v ..., x n , is a function F(x) 
satisfying the following properties. 

(; i ) F(Xj) = fixf, i = 0, 1. . n. (Interpolation conditions). 

(ii) On each subinterval fy _ v xf\, 1 < i < n, Fix) is a polynomial of degree n. 

(iii) F(x) and its first in - 1) derivatives are continuous on (a, b). 

For our discussion, we shall consider cubic splines only. From the definition, a cubic spline 
has the following properties. 

(i) F(Xj) = fixf, i = 0, 1, ..., n. (Interpolation conditions). 

(ii) On each subinterval [x t _ v x t ], 1 < i < n, Fix) is a third degree (cubic) polynomial. 

(iii) Fix), F'ix) and F "(x) are continuous on (a, b). 

Fix) = Pfx) = ape 3 + bpc 2 + epe + d t on [x i V x.] 

Fix) = P l+1 ix) = a i+1 x 3 + b i+1 x 2 + c i+1 x + d i+1 on [x-, x i+1 ]. 


Let 

and 
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On each interval, we have four unknowns a-, b t , c t and d t , i = 1,2, ..., n. Therefore, the 
total number of unknowns is An. 

Continuity of Fix), F'ix) and F"(x) on (a, b ) implies the following. 
ii) Continuity of Fix) : 

On [x-^ x.] : P t (x.) = fix) = a iX f + b t xf + c i x i + d t 

On [Xj, x i+1 \ : P i+1 ix) = fix) = a i+1 xf + b i+1 xf + c i+1 x t + d i+v i = 1, 2, ..., n - 1. (2.49) 

Hi) Continuity of F'ix) : 

3cijxf + ‘Ab i x i + Cj = 3aj +1 xf + 2 b i+1 x t + c i+v i= 1,2, ..., n- 1. (2.50) 

iiii) Continuity ofF"ix) : 

6 aft + 26 ; = 6a i+1 X; + 26 i+1 , i = 1, 2, ..., n- 1. (2.51) 

At the end points x 0 and x n , we have the interpolation conditions 
fix 0 ) = a^Q + b^XQ + C]X o + c6p 

and fi x n) = a n x n + K x n + • (2.52) 

We have 2(n. - 1) equations from (2.49), (n - 1) equations from (2.50), in - 1) equations 
from (2.51) and 2 equations from (2.52). That is, we have a total of 4n - 2 equations. We need 
two more equations to obtain the polynomial uniquely. There are various types of conditions 
that can be prescribed to obtain two more equations. We shall consider the case of a natural 
spline, in which we set the two conditions as F"ix 0 ) = 0, F"ix n ) = 0. 

The above procedure is a direct way of obtaining a cubic spline. However, we shall 
derive a simple method to determine the cubic spline. 

Example 2.21 Find whether the following functions are cubic splines ? 

ii) f(x) = 5x 3 - 3x 2 , - 1 < x < 0 (ii) f(x) = - 2x 3 - x 2 , - 1 < x < 0 

= - 5x 3 - 3x 2 , 0 < x < 1. = 2x 3 + x 2 , 0 < x < 1. 

Solution In both the examples, fix) is a cubic polynomial in both intervals (- 1, 0) and (0, 1). 
ii) We have 

lim fix) = 0 = lim fix ). 

* -> o + * -> o~ 

The given function fix) is continuous on (- 1, 1). 

f'ix) = 15x 2 -6x, - 1 < x < 0 

= - 15x 2 - 6x, 0 < x < 1. 

We have lim f\x) = 0= lim f’ix ). 

* o + * -> o~ 

The function f '(x) is continuous on (- 1, 1). 

f"ix) = 30x - 6, - 1 < x < 0 

= - 30x - 6, 0 < x < 1. 
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We have li m fix) = - 6 = lim fix)- 

x->0 + * 0“ 

The function fix) is continuous on (- 1, 1). 

We conclude that the given function fix ) is a cubic spline. 

Hi) We have 

lim fix) = 0 = lim fix) 

* o + * tr 

The given function fix) is continuous on (- 1, 1). 

f'ix) = - 6x 2 - 2x, - 1 < x < 0 

= 6x 2 + 2x, 0 < x < 1. 

We have hm f'ix) = 0 = hm f'ix) 

The function f'ix) is continuous on (- 1, 1). 

f"ix) = - 12x-2, - 1 < x < 0 

= 12x + 2, 0 < x < 1. 

We have lim fix) = 2 lim fix) = - 2 
* o + * tr 

The function f "(x) is not continuous on (- 1, 1). 

We conclude that the given function fix) is not a cubic spline. 

Cubic spline 

From the definition, the spline is a piecewise continuous cubic polynomial. Hence, 
F'\x) is a linear function of x in all the intervals. 

Consider the interval [x i _ 1 , x-]. Using Lagrange interpolation in this interval, F "(x) can 
be written as 

F'\x) = X ~ Xi F" i Xi f + x ~ x >~ 1 F "( Xi ) 

x i-l ~ x i x i~ x i -1 


X; - X . X - X;_-| . 

= — - - F" ix t _f + - F ixf) 

x i ~ x i -1 x i ~ x i -1 

Denote F"(x i:l ) = Af. ^ and F'ixf = AT. 

Integrating (2.53) with respect to x, we get 

„ ,, . (Xf - x) 2 (x - Xi_f ) 2 

F M M ‘-‘ + a^%) M ‘ + “- 

Integrating (2.54) again with respect to x, we get 

(X* - x) 3 (x - x^) 3 

F(x) = — 1 -r Afi_i + + ax + 6 

6(x ( - x^_,) 6(x, : - x^_ x ) 

where a, 6 are arbitrary constants to be determined by using the conditions 
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Fix^) = flx^) and Fix) = fix). (2.56) 

Denote x t - x i t = h t , fix^ J = f t _ v and fix) = f t . Note that h } is the length of the interval 
[x ; _i, x}. 

To ease the computations, we write 

ax + b = c(x t - x) + dlx - x t _) where a = d-c, b = cx i -d x iV 
That is, we write (2.55) as 

(X;-X) 3 J/f . (X-X;_i) 3 . x j/ X 

Fix) = ~6/i- Mi ~ 1 + - 6 h Mi + C Xi _ X + d(x “ ’ 

Using the condition Flx iX ) = fix t _) = f iV we get 

, ( x t - x^) 3 , . hf t.. 

f. , = - ) + C(X; - X;_i) = — — + Chi 

6/ij 6 hi 

or 

Using the condition Fix) = fix) = f p we get 

(x.-x.-i) 3 ,, „ N hf „ 

f. = — ^ 1 — + dlxi - Xj_ x ) = M, + dh t 

or 

Substituting the expressions for c and d in (2.55), we obtain the spline in the interval [x t _ v x) 
as 


Fix) = ^ [(Xi - x) 3 Mj_ x + (x - x^) 3 M) + (X \ X) 
1 6 hj ‘ h 


h-1- ‘ M t _ 


Note that the spline second derivatives M i V M i are unknowns and are to be determined. 
Setting i = i + 1 in (2.57), we get the spline valid in the interval [x., x. +1 ] as 


' 6Aj +1 


, (x f _!-x) 

h i+ 1 


fi-^Mi 


lx-Xj) 


where /i- +1 = x i+1 - x-. Differentiating (2.57) and (2.58), we get 
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F'lx) = — [- 3(x f - xf M t _ t + 3(x - Xi^f M{] 

1 6/l £ 




valid in the interval [x- v x ], and 




valid in the interval [x £ , x i+1 ]. 

Now, we require that the derivative F\x) be continuous at x = x-. Hence, the left hand 
and right hand derivatives of F\x) at x = x- must be equal, that is, 

lim F'(xj - e) = lim F’ +1 (x £ + e) 

£ —> 0 £ —> 0 

Using (2.59) and (2.60), we obtain 


hj ,. 1 „ hj ,. 1 „ hj , _ 

— M: - f ! + — M: 1 + — fi ~ — M: 

2 J h t 1 6 i_1 ^ 1 6 * 


= - ^ Mi - — ^ + ^Mi + — f i+1 -b^M l+1 
2 ! h i+1 11 6 1 h i+1 1+1 6 ,+1 


or \ M £ _i + \ ^ + h i+1 )Mi + M i+1 = J- ( f i+1 -f^- A (f t - fi_ x ) 

6 3 6 h i+1 hi 

£ = 1,2,..., 7i-l. (2.61) 

This relation gives a system of n - 1 linear equations in n + 1 unknowns M Q , M v ..., M n . 
The two additional conditions required are the natural spline conditions M 0 = 0 = M n . These 
equations are solved for M v M 2 , ..., M n _ v Substituting these values in (2.57), we obtain the 
spline valid in the interval [x £ _ v x £ ]. If the derivative is required, we can find it from (2.59). 
Equispaced data When the data is equispaced, we have h i = h i+1 = h and x- = x 0 + ih. Then, the 
spline in the interval [x £ , v x £ ], given in (2.57) and the relation between the second derivatives 
given in (2.61) simplify as 

Ffx) = g-[(x £ -x ) 3 +(x -x £ _i ) 3 M t ] 



(2.62) 
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AT, + 4 M. + M i+1 = \ if i+ 1 - 2fi + 4_ x ) (2.63) 

h 

i*l, 2 , ..., n- 1 . 

Remark 12 Splines provide better approximation to the behaviour of functions that have 
abrupt local changes. Further, splines perform better than higher order polynomial approxi¬ 
mations. 

Example 2.22 Obtain the cubic spline approximation for the following data. 


X 

0 

1 

2 

fix) 

-1 

3 

29 


with M 0 = 0, M 2 = 0. Hence, interpolate at x = 0.5, 1.5. 

Solution We have equispaced data with h = 1. We obtain from (2.63), 

M t l + 4M i + M i+1 = 6(f i+1 - 2 f + f t _f), i = 1. 

For i = 1, we get 

M 0 + 4 M 1 + M 2 = 6(4 - 24 + 4 ). 

Since, M 0 = 0, M 2 = 0, we get 

4M 1 = 6[29 - 2(3) - 1] = 132, or M x = 33. 

The spline is given by 

Ffx) = | [(Xi - x ) 3 M;_ x + (x- Xi _ x ) 3 M t \ + ( Xi - x) ^_ x - | M t _ t J + (x - x-_ x ) ^ 

We have the following splines. 

On [0, 1]: 

Fix) = ^ [(x x - x) 3 M 0 + (x- x 0 ) 3 M x ] + (x x - x) |^4 - M 0 j + (x - x 0 ) |Vi - ^ M 1 J 

= - (33)x 3 + (1 - x)(— 1) + x (3 - - (33)1 

6 l 6 J 

= - (llx 3 - 3x - 2). 

2 

On [1, 2]: 

Fix) = | [(x 2 - x) 3 M 1 + (x - x x ) 3 M 2 ] + (x 2 - x) ^ x - | M 1 j + (x - x x ) |V 2 -1M 2 J 
= | [(2 - x) 3 (33)] + (2 - x) [3 - i(33)j + (x - 1) [29] 
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Since, 0.5 lies in the interval (0, 1), we obtain 

m5, = f(y-H 

Since, 1.5 lies in the interval (1, 2), we obtain 


17 
16' 


F(1.5) = - [11(2 - L5 ) 3 + 63(L5) - 68 ] = —. 

2 16 

Example 2.23 Obtain the cubic spline approximation for the following data. 


X 

0 

1 

2 

3 

fix) 

1 

2 

33 

244 


with M 0 = 0, M 3 = 0. Hence, interpolate at x = 2.5. 

Solution We have equispaced data with h = 1. We obtain from (2.63), 
M l1 + 4M. + M i+1 = 6(f i+1 - 2/-. + f_f) i= 1, 2. 

For i = 1, we get 

M 0 + 4 M 1 + M 2 = 6(f 2 - 2f 1 + f 0 ) = 6(33 - 4 + 1) = 180. 
For i = 2, we get 


M 1 + 4M 2 + M 3 = 6 (/g - 2f 2 + ff) = 6(244 - 66 + 2) = 1080. 

Since, M 0 = 0, M 3 = 0, we get 

4 M 1 + M 2 = 180, M 1 + 4M 2 = 1080. 

The solution is M 1 = - 24, M 2 = 276. 

The cubic splines in the corresponding intervals are as follows. 

On [0, 1]: 

F(x) = | [tei - x) 3 M 0 + te - * 0 ) 3 Mil + tei “ x) [/o _ ^ M o J + te - ^ [A ~ \ M iJ 
= -x 3 (- 24) + (1- x) + x |~2 - — (- 24)1 = - 4x 3 + 5x + 1. 

6 L 6 J 

On [1, 2]: 

Fix) = ^[(x 2 -x) 3 M 1 + (x-x 1 ) 3 M 2 ] + ix 2 -x)^f 1 -^M 1 j + (x-x x ) | ' f 2 - ^M 2 j 
= | [(2 -x ) 3 (- 24) + (x - l ) 3 (276)] + (2 -x) ^2 - | (- 24)J + (x - 1) ^33 - | (276)J 
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= | [(8 - 12* + 6x 2 - x 3 )(- 24) + (x 3 - 3x 2 + 3x - 1)(276)] + 6(2 - *) - 13(* - 1) 
= 5Ox 3 - 162x 2 + 167x - 53. 

On [2, 3]: 

Fix) = | [(x 3 - x) 3 M 2 + (x - x 2 ) 3 M 3 ] + (x 3 - x) \f 2 -1 M 2 J + (x — x 2 ) |V 8 - | M 3 J 
= | K3 - x) 3 (276)] + (3 - x) ^33 -1 (276)J + (* - 2)(244) 

= | [(27 - 27x + 9x 2 - x 3 ) (276)] - 13(3 - x) + 244(x - 2) 

= - 46x 3 + 414 x 2 - 985 x + 715. 

The estimate at x = 2.5 is 

F( 2.5) = - 46(2.5) 3 + 414(2.5) 2 - 985(2.5) + 715 = 121.25. 

- f REVIEW QUESTIONS j - 

1. What are the advantages of cubic spline fitting? 

Solution Splines provide better approximation to the behaviour of functions that have 
abrupt local changes. Further, splines perform better than higher order polynomial 
approximations. 

2. Write the relation between the second derivatives M, (x) in cubic splines with equal 
mesh spacing. 

Solution The required relation is 

M l _ a + 4M. + M i+1 = jz ( f i+1 - 2 f. + /■-_,), i = 1, 2, ..., n - 1. 

3. Write the end conditions on M.(x) in natural cubic splines. 

Solution The required conditions are Af 0 (x) = 0, M n (x) = 0. 

- f EXERCISE 2.3 ] - 

Are the following functions cubic splines ? 

1. fix) = x 3 - 2x + 3, 0 < x < 1, 

= 2x 3 - 3x 2 + x + 2, 1 < x < 2. 

2. fix) = 5x 3 — 3x 2 + 1, 0 < x < 1, 

= 2x 3 + 6x 2 - 9x + 4, 1 < x < 2. 
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3. fix) = 3x 2 + x + 1, 0 < x < 1, 

= 3x 2 - 5x + 1, 1 < x < 2. 

4. /lx) = x 3 - 3x 2 + 1, 0 < x < 1, 

= x 3 - 2, 1 < x < 2. 

5. Find the values of a, (1 such that the given function is a cubic spline. 

/lx) = a x 3 + (3 x 2 + 2x, - 1 < x < 0. 

= 3x 3 + x 2 + 2x, 0 < x < 1. 

6. Obtain the cubic spline approximation valid in the interval [3, 4], for the function given 
in the tabular form, under the natural cubic spline conditions 

f'\ 1) = M(l) = 0, and f"{ 4) = M(4) = 0. 


X 

1 

2 

3 

4 

fix) 

3 

10 

29 

65 


7. Obtain the cubic spline approximation valid in the interval [1, 2], for the function given 
in the tabular form, under the natural cubic spline conditions/'"(0) = M(0) = 0, and f"{ 3) 
= M(3) = 0. Hence, interpolate at x = 1.5. 


X 

0 

1 

2 

3 

fix) 

1 

4 

10 

8 


8. Fit the following four points by the cubic spline using natural spline conditions 
Mil) = 0, Ml4) = 0. 


X 

1 

2 

3 

4 

fix) 

1 

5 

11 

8 


Hence, estimate /11.5). 

9. Fit the following four points by the cubic spline using natural spline conditions 
Mil) = 0, M(4) = 0. 


X 

1 

2 

3 

4 

fix) 

0 

1 

0 

0 


10. The following values of x and y are given 


X 

1 

2 

3 

4 

fix) 

1 

2 

5 

11 


Find the cubic splines and evaluate y(1.5). 


(A.U. Nov I Dec 2004) 
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2.5 

ANSWERS AND HINTS 


Exercise 2.1 


1. 

(3x-x 2 )/2; 1. 

2. 8x 2 - 19x + 12. 

3. 

(x 3 - 5x 2 + 8x - 2)12. 

4. (3x 3 - 70x 2 + 557x - 690)/60; 44/3. 

5. 

x 3 + x 2 - x + 2; 35. 

6. (x 3 - 9x 2 + 32x - 24)/2; 6. 

7. 

Profit in the year 2000 = 100. 

8. 49.2819. 

9. 

x 3 + x 2 ; 810. 

10. 10x 3 - 27x 2 + 3x + 35; 71. 

11. 

2x 3 - 4x 2 + 4x + 1; 31. 


12. 

- (x 2 - 200x + 6060)/32. Roots of fix ) 

= 0 are x = 162.7694 and x = 37.2306. 

13. 

For fix) = x n+1 , f n+1 © = in + 1) !. 

15. - [xfl 3 ix 1 +x 4 ) +XjX 4 (x 2 +x 3 )]/[x 1 2 x 2 2 x 3 2 x 4 2 ]. 

16. 

(- iyv(x 0 x x ...x„). 

17. x 3 - 9x 2 + 21x + 1; 10. 

18. 

(3x 3 - 70x 2 + 557x - 690); 44/3. 

19. 3x 3 + 7x 2 - 4x - 32; 99. 

20. 

x 3 - x 2 ; 448. 

21. 0.5118199. 

22. 

10x 3 - 27x 2 + 3x + 35; 71. 


Exercise 2.2 


2. 

(- x 3 + 2lx 2 - 126x + 240)/8; 1.25. 

3. (- x 3 - 3x 2 + 16x - 6)/6 ; 1.3125. 

4. 

2x 3 - 7x 2 + 6x + 1; 41. 

5. x 2 + 2x - 3. 

6. 

P(70) = 424. Number of persons with wages between 60 and 70 = (Persons with wages < 
70) - (Persons with wages < 60) = 424 - 370 = 54. 

7. 

0.31815664. 

8. (x 3 + 13x 2 + 56x + 28)/2; 100. 

9. 

9.5037. 

10. 0.0708. 

11. 

ia) [cos (0.12V0.12] = 8.5534, cos (0.12) = 1.0264. (6) 0.9912. Exact value = 0.9928. 
Differences in ib) decrease very fast. Hence, results from ib) will be more accurate. 

Exercise 2.3 


1. 

Cubic spline. 

2. Cubic spline. 

3. 

fix) is not continuous. Not a cubic spline. 

4. 

fix) is not continuous. Not a cubic spline. 

5. 

fix) is a cubic spline for [3=1 and all values of a. 

6. 

M 2 = 112/5, M 1 = 62/5. Spline in [3, 4]: (- 112x 3 + 1344x 2 - 4184x + 4350)/30. 

7. 

M 2 = - 14, M 1 = 8. Spline in [1, 2] : ( 

- 22x 3 + 90x 2 - 80x + 36)/6; 7.375. 

8. 

M 2 = - 76/5, M x = 34/5. Spline in [1, 2]: (17x 3 - 51x 2 + 94x - 45)/15; 2.575. 

9. 

M 2 = 12/5, M x = - 18/5. Spline in [1, 2]: (- 3x 3 + 9x 2 - x - 5)/5. Spline in [2, 3]: 

(30x 3 - 234x 2 + 570x - 414)/30. Spline in [3, 4]: 2(- x 3 + 12x 2 - 47x + 60)/5. 

10. 

M 2 = 4, M 1 = 2. Spline in [1, 2]: (x 3 - 

3x 2 + 5x)/3; 1.375. 




Numerical Differentiation 
and Integration 


3.1 INTRODUCTION 

We assume that a function fix) is given in a tabular form at a set of n + 1 distinct points x Q , x v 
..., x n . From the given tabular data, we require approximations to the derivatives f lr) lx'), r > 1, 
where x' may be a tabular or a non-tabular point. We consider the cases r = 1,2. 

In many applications of Science and engineering, we require to compute the value of the 

definite integral J fix) dx , where fix) may be given explicitly or as a tabulated data. Even 

when f[x) is given explicitly, it may be a complicated function such that integration is not 
easily carried out. 

In this chapter, we shall derive numerical methods to compute the derivatives or evalu¬ 
ate an integral numerically. 


3.2 NUMERICAL DIFFERENTIATION 

Approximation to the derivatives can be obtained numerically using the following two 
approaches 

li) Methods based on finite differences for equispaced data. 

Hi) Methods based on divided differences or Lagrange interpolation for non-uniform data. 

3.2.1 Methods Based on Finite Differences 

3.2.1.1 Derivatives Using Newton’s Forward Difference Formula 

Consider the data lx t , flxff) given at equispaced points^ = x 0 + ih, i = 0, 1, 2,..., n where h is the 
step length. The Newton’s forward difference formula is given by 
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fix) = f[x 0 ) + (x - X Q ) 


A/~o 
1 \h 


(x - x 0 )(x - Xj) 


AA- 

2 \h 2 + 


+ (x - x 0 )(x - X 1 )...(x - x n l ) 


A” fa 


Set x = x 0 + sh. Now, (3.1) becomes 
fix) = flx 0 + sh) 


= f[x 0 ) + sAf 0 + 2 j sis - 1) A 2 f 0 + g , sis - l)(s - 2) A 3 f 0 

1 1 

+ 4is(s- l)(s - 2)(s - 3 ) A% + 57 sis - l)(s - 2 )(s - 3 )(s - 4 )A 5 f 0 + .. 
sis- l)ls-2)...ls-n + Vj 1 2 


Note that s = [x - x Q ]/h > 0. 

The magnitudes of the successive terms on the right hand side become smaller and 
smaller. 

Differentiating (3.2) with respect to x, we get 


d^ = d^ds^ = ld^ 

dx ds dx h ds 

= ^[a/o + |(2 S - 1 )aV o +^(3 S 2 


6s + 2)aV 0 + -!-(4s 3 


18s 2 + 22s - 6) A 4 /o 


+ (5s 4 - 40s 3 + 105s 2 - 100 s + 24)A 5 f 0 + ...J ( 3 . 3 ) 

At x = x 0 , that is, at s = 0, we obtain the approximation to the derivative f '(x) as 

f'(x 0 ) A 7o + | A 3 f 0 - j A 4 f 0 + 1A 5 f 0 - ...j ( 3 . 4 ) 

Differentiating (3.3) with respect to x, we get 

d 2 f _ 1 d (dp j ds _ 1 d (dp\ 
dx 2 h dsyds) dx h 2 dsyds) 

= A [a 2 /a + - ( 6 s - 6 )A 3 /’o + — (12s 2 - 36s + 22)A 4 / 0 
h L 6 24 

+ 1 (20s 3 - 120s 2 + 210s - 100)A 5 / 0 +...1 (3.5) 
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At x = x 0 , that is, at s = 0, we obtain the approximation to the derivative f "(x) as 

rog = ^ [aVo - a 3 /o + ^ aV 0 -1 a 5 /o+aVo -...]. 0.6) 

We use formulas (3.3) and (3.5) when the entire data is to be used. 

Very often, we may require only lower order approximations to the derivatives. Taking 
a few terms in (3.4), we get the following approximations. 

Taking one term in (3.4), we get 

fW = \ A fo=\ -/M> 

or, in general, f'(x k ) = * Af k = * \f(x k+1 ) - flx k )\. (3.7) 

Taking two terms in (3.4), we get 

f'(x 0 ) = A Vo] = \ [(/tei) - fix 0 )} - \ {/te 2 ) - 2/tei) + fix o)}] 


= ^l-3f(x 0 ) + 4f( Xl )-f(x 2 )] 

(3.8) 

or, in general, f \x k ) = ^ [- 3 f(x k ) + 4 f(x k+1 ) - f(x k+2 )]. 

(3.9) 

Similarly, we have the approximation for f "(x 0 ) as 


f"(x 0 ) = Aa 2 /o = 4 {/te 2 ) - 2 f( Xl ) + f(x o)] 

h h, 


or, in general, f"(x k ) = \ “ 2/X**+ 1 )+ A**)] • 

h 

(3.10) 


Errors of approximations. Using Taylor series approximations, we obtain the error in the 
formula (3.7) for f'(x) at x = x k as 

Eif, x k ) = f\x k ) - i [f(x k + h)~ f(x k )\ 

= f’ (x k ) - ^ [{/te*) + hf'ix k ) + f" (x k ) + ...}- Jfte*)j 

= -|rte,) + ... 

The error is of order 0(h), or the formula is of first order. 

The error in the formula (3.8) for f'(x) at x = x k is obtained as 

Eif x k ) = f'(x k ) - l h [- 3 /te*) + 4fx k+1 ) - fix k+2 )l 


(3.11) 
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- \ A**) + 2hf'(x k )+ (2 ^ f"(x h )+ (2 ^ f"'(x k ) +... 


= ^ f"\x k ) + ... (3.12) 

The error is of order Oih 2 ), or the formula is of second order. 

The error in the formula (3.9) for f"(x) atx = x k is obtained as 

Wf x k ) =f" (x k ) -^2 \flx k + 2 A) - 2 f{x k + A) + fix,)] 

= r (*k> - j-j* [{a**) + 2 hf\x k ) + {2} f- f"(x k ) + f"\x k ) + ...| 

- 2 | f{x k ) + hf\x k ) + ~ f"(x k ) + h * /-'"(x^) + ...| + f(x k )j 

= -hf"'(x k ) +... (3.13) 

The error is of order 0(A), or the formula is of first order. 

Remark 1 It can be noted that on the right hand side of the approximation to f\x), we have 
the multiplying factor 1/A, and on the right hand side of the approximation to f "(x), we have 
the multiplying factor 1/A 2 . Since A is small, this implies that we may be multiplying by a 
large number. For example, if A = 0.01, the multiplying factor on the right hand side of the 
approximation to f '(x) is 100, while the multiplying factor on the right hand side of the 
approximation to f'\x) is 10000. Therefore, the round-off errors in the values of fix) and hence 
in the forward differences, when multiplied by these multiplying factors may seriously effect 
the solution and the numerical process may become unstable. This is one of the drawbacks of 
numerical differentiation. 

Remark 2 Numerical differentiation must be done with care. When a data is given, we do not 
know whether it represents a continuous function or a piecewise continuous function. It is 
possible that the function may not be differentiable at some points in its domain. What happens 
if we try to find the derivatives at these points where the function is not differentiable? For 
example, if fix) = \ x \, and a data is prepared in the interval [- 1, 1], what value do we get 
when we try to find f '(x) at x = 0, where the function is not differentiable? 

Remark 3 We use the forward difference formulas for derivatives, when we need the values 
of the derivatives at points near the top of the table of the values. 
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Example 3.1 Find dy/dx at x = 1 from the following table of values 


Solution We have the following forward difference table. 

Forward difference table. Example 3.1. 


We have h= 1, x 0 = 1, and x = x 0 + sh = 1 + s. For x = 1, we get s = 0. 
Therefore, 



Example 3.2 Using the operator relations, derive the approximations to the derivatives f '(x 0 ) 
and f "(x 0 ) in terms of forward differences. 

Solution From the operator relation E = e hD , where D = d/dx, we obtain 
hDf{x 0 ) = log E[fix 0 )] = log (1 + A) flx 0 ) 




rfr 0 ) = jr - 2 A /o +3 A 7 o - - AVo + g AVo - -J 
h 2 D 2 fix 0 )= Uog(l + A)] 2 /(x 0 ) 
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or f"lxj = pr [ 4 V» - aVo + || tfh -1 aVo + ^ A # /o -...] 

Example 3.3 Find f '(3) and f "(3) for the following data: 



3.0 

3.2 

3.4 

3.6 

3.8 

4.0 

fix) 

- 14 

- 10.032 

- 5.296 

- 0.256 

6.672 

14 


[A. U. April / May 2005\ 

Solution We have h = 0.2 and x = x 0 + sh = 3.0 + s(0.2). For x = 3, we get s = 0. 

We have the following difference table. 


Forward difference table. Example 3.3. 



f'(x 0 ) = A Vo +1 A 3 /o - \ A 4 /o +1 A'Vo] 


f (3.0) = ■ 1 I”3.968 - l (0.768) + ~ (- 0.464) - A (2.048) + V 5.120)1 = 9.4667. 
U.^ |_ Z o 4 o J 


n* 0 ) = p- [a 2 /o - A 3 f 0 + ^ A 4 /o - | A 5 /o] 


/■" (3.0) 


0.768 + 0.464 + — (2.048) - (- 5.12) 


= 184.4 
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Example 3.4 The following data represents the function fix) = e 2x . Using the forward differ¬ 
ences and the entire data, compute the approximation to fXO.3). Also, find the first order and 
second order approximations to f'(Q.3). Compute the approximation to f"{ 0.3) using the entire 
data and the first order approximation. Compute the magnitudes of actual errors in each case. 


X 

0.0 

0.3 

0.6 

0.9 

1.2 

fix) 

1.0000 

1.8221 

3.3201 

6.0496 

11.0232 


Solution The step length is h = 0.3 and x = x 0 + sh = 0.0 + s(0.3). For x = 0.3, we get 
8=1. We have the following forward difference table. 


Forward difference table. Example 3.4. 


X 

f(x) 

A f 

A 2 f 

A 3 f 

A 4 f 

0.0 

1.0000 







0.8221 




0.3 

1.8221 


0.6759 





1.4980 


0.5556 


0.6 

3.3201 


1.2315 


0.4570 



2.7295 


1.0126 


0.9 

6.0496 


2.2441 





4.9736 




1.2 

11.0232 






From (3.3), we have the following approximation for s = 1. 


f\x 0 + sh) = f'(x 0 + /i) = -^A/o + ! AVo - i A 3 /o + i AVoj 

n0.3) = — \ 0.8221 + - (0.6759) - - (0.5556) + — (0.4570)1 = 3.6851. 
0.3 |_ 2 6 12 j 

The first order approximation gives 

f'(0.3) = l Aflfl.3) = ^ tT(0.6) -fl.0.3)] 

h U.o 

= — [3.3201 - 1.8221] = 14980 = 4.9933. 

0.3 0.3 

nXk) = lk [ - 3 ^ ) + 4 A% + x ) -^ + 2 )] - 


From (3.9), 
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We get the second order approximation as 

/■'(°. 3) = ^ [- 3 /(0.3) + 4 /(0.6) - /(0.9)] 

= [- 3(1.8221) + 4(3. 3 201) - 6.0496] = 2.9408. 

The exact value is f(0.3) = 2e 0 - 6 = 2(1.8221) = 3.6442. 

The errors in the approximations are as follows: 

First order approximation: | 4.9933 - 3.6442 | = 1.3491. 

Second order approximation: | 2.9408 - 3.6442 | = 0.7034. 

Full data: | 3.6851 - 3.6442 | = 0.0409. 

From (3.5), we have the following approximation for s = 1. 

f"(x 0 + sh ) = f"(x 0 + h) = jz [aV 0 - ^ A Vo J 

f "(0.3) = — [0.6759 - — (0.4570)1 = 7.0869. 

0.0912 J 

The first order approximation gives 

f"( 0.3) = A 2 /(0.3) = l/(0.9) - 2/(0.6) + /(0.3)] 

h h 

= ^ [6.0496 - 2(3.3201) + 1.8221] = 13.6833. 

The exact value is f "(0.3) = 4e 0 - 6 = 7.2884 
The errors in the approximations are as follows: 

First order approximation: | 13.6833 - 7.2884 | = 6.3949. 

Full data: | 7.0869 - 7.2884 | = 0.2015. 

Example 3.5 The following data gives the velocity of a particle for 8 seconds at an interval of 
2 seconds. Find the initial acceleration using the entire data. 


Time (sec) 

0 

2 

4 

6 

8 

Velocity (mlsec) 

0 

172 

1304 

4356 

10288 


Solution If v is the velocity, then initial acceleration is given by 



We shall use the forward difference formula to compute the first derivative at t = 0. The 
step length is h = 2. 

We form the forward difference table for the given data. 
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Forward difference table. Example 3.5. 


X 

fix) 

W 

A 2 f 

A 3 f 

A 4 f 

0 

0 







172 




2 

172 


960 





1132 


960 


4 

1304 


1920 


0 



3052 


960 


6 

4356 


2880 





5932 




8 

10288 






We have the following result: 


= |av„ + |av„-...] 

/•'(0)=|[l72-|(960) + |(960)] = 6. 

3.2.1.2 Derivatives Using Newton’s Backward Difference Formula 

Consider the data (x t , flxf)) given at equispaced points x- = x 0 + ih, where h is the step length. 
The Newton’s backward difference formula is given by 

fix) = fix) + (x - x) V fix) + (x - x )(x - x.) —V 2 fix J + ... 

1 \h n nl 2 \h 2 


1 

+ (x — x )(x — x f)... lx - xf)—— y n fix ). (3.14) 

n n-i 1 n ! h n 

Let x be any point near x n . Let x - x n = sh. Then, the formula simplifies as 

fix) = flx n + sh) = flx n ) + sVflx n ) + s( ^ 1) - V 2 flx n ) + S(S+ g| S + 2) V 3 flx n ) 

sis + l)(s + 2)(s + 3) 4 sis + l)(s + 2)(s + 3)(s + 4) 5 

4! 5! 


sis + l)(s + 2)... Is + n — 1) 

+- . - V n f{x n ). 


(3.15) 


Note that s = [(x - x n )/h\ < 0. 

The magnitudes of the successive terms on the right hand side become smaller and 
smaller. 
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Differentiating (3.15) with respect to x, we get 

df _df ds _ 1 df 
dx ds dx h ds 

= T \Wn + - (28 +1 )V 2 f n + - (3s 2 + 6s + 2)V 3 f n + — (4s 3 + 18s 2 + 22s + 6 W 4 f n 
h [ 2 6 24 

+ (5s 4 + 40s 3 + 105s 2 + 100s + 24) V 5 /; + ...J. (3.16) 

At x = x n , we get s = 0. Hence, we obtain the approximation to the first derivative f '(x n ) as 

f'K) = \ [’ Vf n + \v 2 fn+\ v 3 fn +\ 1V 5 /; (3.17) 

At x = x n V we have x n l = x n - h = x n + sh. We obtain s = - 1. Hence, the approximation to the 
first derivative f '( x n l ) is given by 


w» - | va- ivy. - Aw.+ ■} (3.i8) 

Differentiating (3.16) with respect to x again, we get 

d 2 f _ 1 d (df\ds _ 1 d (df\ 
dx 2 h ds yds J dx h 2 ds yds) 

= \ V 2 f n + - (6s + 6)V 3 f n + — (12s 2 + 36s + 22)V 4 f n 
h L 6 24 

+ (20 s 3 + 120s 2 + 210s + 100)V 5 /; + ...J. (3.19) 

At x = x n , that is, at s = 0, we obtain the approximation to the second derivative f "(x) as 

r<*„> - JW. + VV. + £ VY„ + ! V % + Vv. +...]. (3.20) 

At x = x n l , we get s = - 1. Hence, we obtain the approximation to the second derivative 
f" (*n_l) aS 

rw=|[n-Av,-Iv‘/.,."]. (3.21, 


We use the formulas (3.17), (3.18), (3.20) and (3.21) when the entire data is to be used. 
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Remark 4 We use the backward difference formulas for derivatives, when we need the values 
of the derivatives near the end of table of values. 


Example 3.6 Using the operator relation, derive approximations to the derivatives 
f'(x n ), f'\x n ) in terms of the backward differences. 

Solution From the operator relation E = e hD , where D = d/dx, we obtain 

hDfa n ) = [log E] f(x n ) = log [(1 - V)- 1 ] f(x n ) = - log (1 - V) flx n ) 




f\x n ) = 


\wf n + - V 2 fn + - v 3 /; + - vV_ + - V 5 f n +.. 
L 2 n 3 /n 4 ,n 5 ,n 


v 2 V 3 V 4 V 5 

h*D*f(.x n ) = [log (1 - V)] 2 f[x n ) = r + ^f + Y + ^ + ~5~ + ' 
f" C* B ) = pf [v 2 fn + V 3 fn + V 4 fn + | V 5 f n + ...j. 


fix) 


Example 3.7 Find f \3) using the Newton’s backward difference formula, for the data 


* 

1.0 

1.5 

2.0 

2.5 

3.0 

f(x) 

- 1.5 

- 2.875 

-3.5 

- 2.625 

0.5 


Solution The step length is h = 0.5 and x = x n + sh = 3.0 + s(0.5). For x = 3.0, we get 
s = 0. We have the following backward difference table. 


Backward difference table. Example 3.7. 
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From the formula 

f\x n ) = i \vf n + 1V 2 f n +1 v 3 /; +1 vV„ +1V 5 /; + ...J, 

we obtain f\ 3) = ^ ^3.125 +1 (2.25) + | (0.75)J = 9. 


Example 3.8 Find f '(2.5), f '(2) and f "(2.5) using the Newton’s backward difference method, 
for the data of the function f(x) = e x + 1. 


X 

1.0 

1.5 

2.0 

2.5 

Ax) 

3.7183 

5.4817 

8.3891 

13.1825 


Find the magnitudes of the actual errors. 

Solution The step length is h = 0.5 and x = x n + sh = 2.5 + s( 0.5). For x = 2.5, we get 
s = 0. The backward difference table is given below. 


Backward difference table. Example 3.8. 



From the formula 


we obtain 


/”<*„> - \^fn + 1 V*f. + 1 V’A + \ V7. +1 vV. +...], 

f\ 2.5) = f [4.7934 + 1 08860) + 1 (0.7420)] = 11.9675. 


The exact value is f'(2.5) = e 2 - 5 = 12.1875. The magnitude of the error in the solution is 
| Error | = | 12.1875-11.9675 | =0.2150. 

For x = 2.0, we get s = — 1. From the formula 


f\x n _ i) = 
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weget r(2)=t L[v4-|vV„-iv3^ 

= — T4.7934 - - (L8860) - - (0.7420)1 = 7.4535. 

0.5 L 2 6 J 

The exact value is f'{2) = e 2 = 7.3891. The magnitude of the error in the solution is 
| Error | = | 7.3891 - 7.4535 | = 0.0644. 

For x = 2.5, we get s = 0. From the formula 

f"(X n ) = ^ ^fn + V 3 fn + ^ V 4 f n + | + ... j, 

we get f"{ 2.5) = ^ [1.8660 + 0.7420] = 10.5120. 

The exact value is /" "(2.5) = e 2 - 5 = 12.1875. The magnitude of the error in the solution is 
| Error | = | 12.1875-10.5120 | = 1.6705. 

Example 3.9 The following data represents the function fix) = e 2 *. 


X 

0.0 

0.3 

0.6 

0.9 

1.2 

fix) 

1.0000 

1.8221 

3.3201 

6.0496 

11.0232 


Find f '{1.2) f T0.9) and f "(1.2), using the Newton’s backward difference method. 
Compute the magnitudes of the errors. 

Solution The step length is h = 0.3. We have the following backward difference table. 


Backward difference table. Example 3.9. 


X 

f(x) 

W 

V 2 / 

V 3 / 

V 4 f 

0.0 

1.0000 







0.8221 




0.3 

1.8221 


0.6759 





1.4980 


0.5556 


0.6 

3.3201 


1.2315 


0.4570 



2.7295 


1.0126 


0.9 

6.0496 


2.2441 





4.9736 




1.2 

11.0232 
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From x = x n + sh = 1.2 + s(0.3), we get for x = 1.2, s = 0. Using the formula 

r<*„> = i [v. 4 W. U w. + 1 v % U W. + ...], 

we get f\ 1.2) = ^ [4-9736 + | (2.2441) +1 (10126) + j (0.4570)] = 21.8248. 


The exact value is f'( 1.2) = 2e 2 - 4 = 22.0464. 

The magnitude of the error is 

| Error | = | 22.0464 - 21.8248 | = 0.2216. 

From x = x n + sh = 1.2 + s(0.3), we get for x = 0.9, s = - 1. Using the formula 


we get 


r<v,>4[ % 


- vV„ - - v 3 /-„ -—v 4 /; -— v 5 f n +... 

2 n g In 12 /n 2Q /n 


/■'(O 9) = — 4.9736 - - (2.2441) - - (10126) - — (0.4570) 

' y ’ 0.3 L 2 6 12 J 


= 12.1490. 


The exact value is f'{0.9) = 2e 18 = 12.0993. 

The magnitude of the error is 

| Error | = | 12.0993- 12.1490 | = 0.0497. 

From x = x n + sh = 1.2 + s(0.3), we get for x = 1.2, s = 0. Using the formula 


we get f'X 1.2) = ^ [2.2441+ 10126 + || (0.4570)] = 40.8402. 

The exact value is /"(1.2) = 4e 2 - 4 = 44.0927. 

The magnitude of the error is 

| Error | = | 40.8402 - 44.0927 | = 3.2525. 

3.2.1.3 Derivatives Using Divided Difference Formula 

The divided difference interpolation polynomial fitting the data (x., fixj), i = 0, 1, 2,..., n is 
given by 

fix) = ftx 0 ) + (x - X 0 ) f [x 0 , Xj] + (x - x 0 )(x - x x ) f [x 0 , x ls x 2 ] + ... 

+ (x - x 0 )(x - X-f) (x - x 2 ) f [x 0 , x ls x 2 ] + ... 

+ (x - x 0 )(x - x x ) ... (x - X n-1 ) f [x 0 , X-p... xj 


(3.22) 
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Differentiating with respect to x, we get 

f'(x) = f [x 0 , xj + [(x - x 0 ) + (x - x x )] f [x 0 , x p x 2 ] + [(x - x 4 )(x - x 2 ) + (x - x 0 )(x - x 2 ) 

+ (x - x 0 )(x - X-,)] f [x 0 , x v x 2 , x 3 ] + [(x - x^Cx - x 2 )(x - x 3 ) + (x - x 0 )(x - x 2 )(x - X 3 ) 
+ (x - x 0 )(x - x 4 ) (x - X 3 ) + (x - x 0 )(x - x 4 )(x - x 2 )] f [x 0 , X v x 2 , X 3 , x 4 ] + ... (3.23) 

If the derivative f'ix) is required at any particular point x = x*, then we substitute x = x* 
in (3.23). If the data is equispaced, then the formula is simplified. 

Differentiating (3.23) again, we obtain 

f "(x) = 2 f [x 0 , x v x 2 ] + 2 [(x - x 0 ) + (x - x 4 ) + (x - x 2 )] f [x 0 , x v x 2 , x 3 ] 

+ 2[(x - x 0 )(x - x 4 ) + (x - x 0 )(x - x 2 ) + (x - x 0 )(x - X 3 ) + (x - x 4 )(x - x 2 ) 
+ (x - x 4 )(x - x 3 ) + (x - x 2 )(x - x 3 )] f [x 0 , x v x 2 , x 3 , x 4 ] + ... (3.24) 

If the second derivative /""(x) is required at any point x = x*, then we substitute x = x ! in 
(3.24). Again, if the data is equispaced, then the formula is simplified. 

However, we can also determine the Newton’s divided differences interpolation polyno¬ 
mial and differentiate it to obtain f '(x) and f "(x). 

Example 3.10 Find the first and second derivatives at x = 1.6, for the function represented by 
the following tabular data: 


X 

1.0 

1.5 

2.0 

3.0 

fix) 

0.0 

0.40547 

0.69315 

1.09861 


[A.U. Nov./Dec. 2005] 

Solution The data is not equispaced. We use the divided difference formulas to find the 
derivatives. We have the following difference table: 


Divided differences table. Example 3.10. 


X 

fix) 

First d.d 

Second d.d 

Third d.d 

1.0 

0.00000 

0.81094 



1.5 

0.40547 

0.57536 

- 0.235580 

0.061157 

2.0 

0.69315 

0.40546 

- 0.113267 


3.0 

1.09861 





Substituting x = 1.6 in the formula 

f'ix) = f [x 0 , Xj] + [(x - x 0 ) + (x - x 4 )] f [x 0 , x v x 2 ] + [(x - x 1 )(x - x 2 ) + (x - x 0 )(x - x 2 ) 
+ (x - x 0 )(x - x 4 )] f [x 0 , x v x 2 , x 3 ] 
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we obtain f'{ 1.6) = 0.81094 + [(1.6 - 1.0) + (1.6 - 1.5)] (- 0.23558) + [(1.6 - 1.5)(1.6 - 2.0) 

+ (1.6 - 1.0X1.6 - 2.0) + (1.6 - 1.0X1.6 - 1.5)] (0.061157) 

= 0.81094 + 0.7 (- 0.23558) - 0.22(0.061157) = 0.63258. 

Substituting x = 1.6 in the formula 

f"(x) = 2 f [x 0 , x v x 2 \ + 2[(x - x 0 ) + (x - x x ) + (x - x 2 )] f [x 0 , x v x 2 , x 3 ] 
we obtain f"( 1.6) = 2(- 0.23558) + 2[(1.6 - 1.0) + (1.6 - 1.5) + (1.6 - 2.0)](0.061157) 

= - 0.47116 + 0.03669 = - 0.43447. 

Remark 5 Often, in applications, we require the maximum and/ or minimum of a function 
given as a tabulated data. We may obtain the interpolation polynomial, differentiate it and 
set it equal to zero to find the stationary points. Alternatively, we can use the numerical 
differentiation formula for finding the first derivative, set it equal to zero to find the station¬ 
ary points. The numerical values obtained for the second derivatives at these stationary points 
decides whether there is a maximum or a minimum at these points. 

- f REVIEW QUESTIONS J - 

1. What are the drawbacks of numerical differentiation? 

Solution Numerical differentiation has two main drawbacks, (i) On the right hand 
side of the approximation to f'(x), we have the multiplying factor 1/h, and on the right 
hand side of the approximation to f "(x), we have the multiplying factor 1/h 2 . Since h is 
small, this implies that we may be multiplying by a large number. For example, if 
h = 0.01, the multiplying factor on the right hand side of the approximation to f'ix) is 
100, while the multiplying factor on the right hand side of the approximation to f"(x) is 
10000. Therefore, the round-off errors in the values of /lx) and hence in the forward 
differences, when multiplied by these multiplying factors may seriously effect the solu¬ 
tion and the numerical process may become unstable, (ii) When a data is given, we do 
not know whether it represents a continuous function or a piecewise continuous func¬ 
tion. It is possible that the function may not be differentiable at some points in its 
domain. If we try to find the derivatives at these points where the function is not differ¬ 
entiable, the result is unpredictable. 

2. Given the data (x., fix/)), 7 = 0, 1, 2,..., n at equispaced points x. = x Q + ih where h is the 
step length, write the formula to compute f'ix 0 ), using the Newton’s forward difference 
formula. 

Solution In terms of the forward differences, we have the formula 

r(x 0 ) = l [a/o - | AVo + | A 3 /o - * AVo +1 aVo - 

3. Given the data (x p fix/)), i = 0, 1, 2. n at equispaced points x i =x Q + ih, where h is the 

step length, write the formula to compute f"(x 0 ), using the Newton’s forward difference 
formula. 
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Solution In terms of the forward differences, we have the formula 

n*„> - ~t [aV„ - AY. + £ AV„ -1AV.+av. 

4. Given the data (x., /(x.)), i = 0, 1, 2.n at equispaced points x. = x Q + ih, where h is the 

step length, write the formula to compute f '( x n ) using the Newton’s backward differ¬ 
ence formula. 

Solution In terms of the backward differences, we have the formula 

f'(x n ) = \ [v/-„ + 1 vv„ + \ V 3 fn +\ vV„ + 1 w. + ...]. 

5. Given the data (x., /(x^)), i = 0, 1, 2,..., n at equispaced points x. = x Q + i/i, where h is the 
step length, write the formula to compute f\x nl ), using the Newton’s backward differ¬ 
ence formula. 

Solution In terms of the backward differences, we have the formula 

- 1 vv, - 1 W. - i W. - £ W. ♦...]. 

6. Given the data (x., /(x^), i = 0, 1, 2,..., n at equispaced points Xj = x 0 + ih, where h is 
the step length, write the formula to compute f "(x n ), using the Newton’s backward 
difference formula. 

Solution In terms of the backward differences, we have the formula 

f X) - ffif. ♦ W.+£ vv» + ! V V .♦% V+...]. 

7. What is the error in the following approximation? 

f'(x k )=±[fix k+1 )-fix k )l 

Solution Using the Taylor series expansion of fix k+1 ), we get the error of approxima¬ 
tion as 

E(f x k ) = f'{x k ) - l h \fix k + h) -fix,)] = - \ f"ix k ) + ... 

8. What is the error in the following approximation? 

/"<*,) = ^ [ - 3 /<**> + 

Solution Using the Taylor series expansion of fix k+1 ) and fix k+2 ), we get the error of 
approximation as 

W, **) =f'(x k ) ~l h [-3 fix k ) + 4fix h+1 ) - fix k+2 )] = £ f"\x k ) + ... 
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- ( EXERCISE 3.1 ) - 

1. The following data gives the velocity of a particle for 20 seconds at an interval of 5 
seconds. Find the initial acceleration using the entire data. 


Time (sec) 

0 

5 

10 

15 

20 

Velocity (m/sec) 

0 

3 

14 

69 

228 


(A. U. April /May 2004 ) 

2. Compute f'{ 0) and f"(4) from the data 


20.086 54.598 

(A.U. May 2000) 


3. Find the maximum and minimum values of y tabulated below. 


4. Find the value of x for which fix) is maximum in the range of x given, using the follow¬ 
ing table. Find also the maximum value of fix). 


1120 930 

(A.U. Nov. /Dec. 2004) 


5. For the given data 


find dy/dx, d 2 y/dx 2 at 1.1. (A.U. Nov. I Dec. 2003) 

6. The first derivative at a point x k , is approximated by 

f(x k ) = \fix k + h)~ fix k - h)\l(2h). 

Find the error term using the Taylor series. 

7. From the following table 


y 


1.0 

2.7183 


1.2 

3.3201 


1.4 

4.0552 


1.6 

4.9530 


1.8 

6.0496 


2.0 

7.3891 


2.2 

9.0250 


obtain dy/dx, d 2 y/dx 2 at x = 1.2. 


(A. U. Nov. / Dec. 2006) 
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8. Obtain the value of f '(0.04) using an approximate formula for the given data 


y 


0.01 

0.1023 


0.02 

0.1047 


0.03 0.04 


0.1071 0.1096 


0.05 

0.1122 


0.06 


0.1148 


9. Find the value of sec 31° for the following data 


(At/. Nov. I Dec. 2003) 


6 (deg) 

31 

32 

33 

34 

tan 0 

0.6008 

0.6249 

0.6494 

0.6745 


(A.U. Nov. I Dec. 2004) 

10. Find f'iX) using the following data and the Newton’s forward difference formula. 


X 

1.0 

1.5 

2.0 

2.5 

3.0 

Ax) 

- 1.5 

- 2.875 

-3.5 

- 2.625 

0.5 


11. Using the Newton’s forward difference formula, find f\ 1.5) from the following data. 


X 

1.0 

1.5 

2.0 

2.5 

Ax) 

3.7183 

5.4817 

8.3891 

13.1825 


Find the magnitude of the actual error, if the data represents the function e x + 1. 

12. Given the following data, find y '(6), y '(5) and the maximum value of y. 


466 


922 


13. Given the following data, find y '(6). 


(A.U. May/Jun. 2006 ) 


14. An approximation to f"(x) is given by 


(At/. Nov. I Dec. 2006 ) 


f"(x) = T2 \Hx + h)~ 2 f(x) +f(x- h)]. 
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Compute f"i 0.3) using this formula with all possible step lengths for the given data. 


* 

0.1 

0.2 

0.3 

0.4 

0.5 

fix) 

2.3214 

2.6918 

3.1221 

3.6255 

4.2183 


If the data represents the function fix) = e 2 * + x + 1, what are the actual errors? Which 
step length has produced better result? 


3.3 NUMERICAL INTEGRATION 


3.3.1 Introduction 

The problem of numerical integration is to find an approximate value of the integral 


= J wix) fix) a 


(3.25) 


where wix) > 0 in (a, b) is called the weight function. The function fix) may be given explicitly 
or as a tabulated data. We assume that wix) and wix) fix) are integrable on [a, b ]. The limits of 
integration may be finite, semi-infinite or infinite. The integral is approximated by a linear 
combination of the values of fix) at the tabular points as 


/ = J wix) fix) dx = ^ \ fix k ) 

Ja k = o 

= \ fix 0 ) + X 1 fixf) + X 2 fix 2 ) + ... + X n fix n ). (3.26) 

The tabulated points x k ’s are called abscissas, fixff s are called the ordinates and Xfs 
are called the weights of the integration rule or quadrature formula (3.26). 

We define the error of approximation for a given method as 

R n if) = f w(x) fix) dx - £ \ fix k ). (3.27) 

“ k = 0 

Order of a method An integration method of the form (3.26) is said to be of order p, if it 
produces exact results, that is R n = 0, for all polynomials of degree less than or equal to p. That 
is, it produces exact results for fix) = 1, x, x 2 , ...., x p . This implies that 

R n ix m ) = J wix) x m dx - ^ X k x k m = 0, for m = 0, 1, 2, ..., p. 

“ k = 0 

The error term is obtained for fix) = x p+1 . We define 

c = f wix) x p+1 dx - ^ X k x k p+1 (3.28) 


where c is called the error constant. Then, the error term is given by 











NUMERICAL DIFFERENTIATION AND INTEGRATION 


129 


R n (f) = £ w(x) fix) dx-^ x k flx k ) 

= T a <^<b. (3.29) 

Ip + 1)! 

The bound for the error term is given by 

| R n if) | < , |C ' , max | f ip+1) (x). (3.30) 

(p+ 1): a<x<b 

If R n (x p+1 ) also becomes zero, then the error term is obtained for fix) = x p+2 . 

3.3.2 Integration Rules Based on Uniform Mesh Spacing 

When w(x) = 1 and the nodes xfs are prescribed and are equispaced with x Q = a, x n = b, where 
h = (b - a)/n, the methods (3.26) are called Newton-Cotes integration rules. The weights Xfs 
are called Cotes numbers. 

We shall now derive some Newton-Cotes formulas. That is, we derive formulas of the 

form 

I=\ b fix) dx=Yu KAx k ) 

Ja k = 0 

= \ Ax 0 ) + X 1 Axf) + X 2 Ax 2 ) +... + x n Ax n ). (3.31) 

f 6 

We note that, /(x) dx defines the area under the curve y = /(x), above the x-axis, 
between the lines x = a, x = b. 

3.3.2.1 Trapezium Rule 

This rule is also called the trapezoidal rule. Let the curve 
y = /(x), a < x < b, be approximated by the line joining the 
points P{a, /(a)), Qlb, fib)) on the curve (see Fig. 3.1). 

Using the Newton’s forward difference formula, the 
linear polynomial approximation to /(x), interpolating at 
the points P(a, /(a)), Qlb, /(&)), is given by 

Ax) = Ax 0 ) + | (* - V A /^ 0 ) ( 3 - 32 ) 

where x 0 = a, x 1 = b and h = b - a. Substituting in (3.31), 
we obtain 

/ = £ fix) dx = £ flx)dx = flx 0 ) £ dx + £ jjj 1 (x - x 0 )dxj Af 0 
= (x x - X 0 ) Ax 0 ) + ^ [I (x _ *o) 2 ] A/o 


y t 



'oj a b 


Fig. 3.1. Trapezium rule. 
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= (x x - x 0 ) fix 0 ) + l/lx^ - /(x 0 )](x 1 - x 0 ) 2 

= hf{x 0 ) + ^ I fixfi - /(x 0 )] 

= | l/W) +/C*o)] = I fib) + fia)]. 

The trapezium rule is given by 

I = £ fix) dx= | \fixfi + fix 0 )] = I fib) + fia)]. (3.33) 

Remark 6 Geometrically, the right hand side of the trapezium rule is the area of the trap¬ 
ezoid with width b - a, and ordinates fia) and fib), which is an approximation to the area 
under the curve y = fix) above the x-axis and the ordinates x = a and x = b. 

Error term in trapezium rule We show that the trapezium rule integrates exactly polyno¬ 
mial of degree < 1. That is, using the definition of error given in (3.27), we show that 
Rtf, x) = 0 for fix) = 1, x. 

Substituting fix) = 1, x in (3.27), we get 

fix) = 1: i? 1 (/,x)=£ dx- (2) = (6-o)-(6-a) = 0. 

fix) = x: Rtf,x) = £ xdx- ( ^ ) (6+a)= * (6 2 -a 2 )- * (6 2 -a 2 ) = 0. 

Hence, the trapezium rule integrates exactly polynomial of degree < 1, and the method 
is of order 1. 

Let fix) = x 2 . From (3.28), we get 

c = J x 2 dx - ^ ^ a ^ (b 2 + a 2 ) = ^ {b - a) 3 - ^ (6 3 + a 2 b - ab 2 - a 3 ) 

= ^ (a 3 - 3 a 2 b + 3ab 2 - b 3 ) = - ^ (b - a) 3 , 
b b 

Using (3.29), the expression for the error is given by 

Rtf, x)=f; f'%) = ~ f'%) = ~ f'%) (3-34) 

where a < \ < b. 

The bound for the error is given by 

| R 1 (fix) | = where M 2 = max \f"{x)\- 


(3.35) 
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If the length of the interval [a, b ] is large, then b — a is also large and the error expres¬ 
sion given (3.35) becomes meaningless. In this case, we subdivide [a, b] into a number of 
subintervals of equal length and apply the trapezium rule to evaluate each integral. The rule 
is then called the composite trapezium rule. 

Composite trapezium rule Let the interval [a, b] be subdivided into N equal parts of length h. 
That is, h = (b - a)/N. The nodal points are given by 

a = x 0 , x 1 = x 0 + h, x 2 = x 0 + 2 h, ..., x N = x 0 + Nh = b. 

We write 


J f(x)dx = J N f(x)dx = J 1 f(x)dx + J 2 f(x)dx + ...+ J N f(x)dx. 


There are N integrals. Using the trapezoidal rule to evaluate each integral, we get the 
composite trapezoidal rule as 

£ fW dx = \ [{fao> + A*])} + l/^i) + A* 2 )} + ••• + + /(%)}] 

= | |/(x 0 ) + 2{/(x 1 ) + fix 2 ) + ... + ftx N _ % )} + flpc N )l. (3.36) 

The composite trapezium rule is also of order 1. 

The error expression (3.34) becomes 

R 1 (f,x)=- f ^[r^ 1 ) + r^ 2 ) + ...+r^ N )], x N ^<% N <x N . ( 3 . 37 ) 

The bound on the error is given by 

1 R&X) \<^i\f'% 1 )\+\r% 2 )\+...+\r% N )\] 


or 

where 


, Nh\, (b - a)h 2 a 

‘T2- Ma= — 


I I - 

M 2 = max | f"{x) | and Nh = b - a. 


(3.38) 


This expression is a true representation of the error in the trapezium rule. As we increase 
the number of intervals, the error decrases. 

Remark 7 Geometrically, the right hand side of the composite trapezium rule is the sum of 

areas of the N trapezoids with width h, and ordinates /lx i ;L ) and /fx £ ), i= 1,2.. N. This sum 

is an approximation to the area under the curve y = fix) above the x-axis and the ordinates 
x = a andx = b. 
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Remark 8 We have noted that the trapezium rule and the composite trapezium rule are of 
order 1. This can be verified from the error expressions given in (3.34) and (3.37). If fix) is a 
polynomial of degree < 1, then f"{x) = 0. This result implies that error is zero and the trape¬ 
zium rule produces exact results for polynomials of degree < 1. 

Example 3.11 Derive the trapezium rule using the Lagrange linear interpolating polynomial. 

Solution The points on the curve are P(a, fia)), Qib, fib )) (see Fig. 3.1). Lagrange linear inter¬ 
polation gives 


_ , ix-b) .. . ix-a) .... 


= 7T ~—7 MW -/&*)> * + Wa) - afib)}]. 

( b-a ) 

Substituting in the integral, we get 

I = [ b fix) dx = —f 6 [[fib) - f(a))x + {bfia) - afib)}] dx 
Ja ( b - a) Ja 

= 7 T~—r \ I {fib) - fia)} ib 2 -a 2 ) + [tbfia) - afib))ib - o)l 
ib-a) 12 J 

* | ib + a)[fib)-fia )] + bfia) - afib) 

= {b ~ 2 a) im+fib)} 
which is the required trapezium rule. 

r 1 dx 

Example 3.12 Find the approximate value of I = —using the trapezium rule with 2, 4 

Jo l + x 

and 8 equal subintervals. Using the exact solution, find the absolute errors. 

Solution With N = 2, 4 and 8, we have the following step lengths and nodal points. 

N = 2: h= b a = The nodes are 0, 0.5, 1.0. 

N 2 

b — a 1 

N = 4: h = rrz =—. The nodes are 0, 0.25, 0.5, 0.75, 1.0. 

N 4 

N=8:h= = -. The nodes are 0, 0.125, 0.25, 0.375, 0.5, 0.675, 0.75, 0.875,1.0. 

N 8 
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We have the following tables of values. 

N=2: x 0 0.5 1.0 

fix) 1.0 0.666667 0.5 

N = 4: We require the above values. The additional values required are the following: 


* 

0.25 

0.75 

fix) 

0.8 

0.571429 


N = 8: We require the above values. The additional values required are the following: 


* 

0.125 

0.375 

0.625 

0.875 

fix) 

0.888889 

0.727273 

0.615385 

0.533333 


Now, we compute the value of the integral. 

N = 2: ^ | |/(0) + 2/10.5) + /U.0)] 

= 0.25 [1.0 + 2(0.666667) + 0.5] = 0.708334. 

N = 4: I 2 = | |/(0) + 2{/(0.25) + /(0.5) + /(0.75)} + /(1.0)] 

= 0.125 [1.0 + 2 [0.8 + 0.666667 + 0.571429} + 0.5] = 0.697024. 

N = 8: I 3 = | |/(0) + 2{/(0.125) + fi 0.25) + fi 0.375) + /(0.5) 

+ /(0.625) + /(0.75) + /(0.875)} + /(1.0)] 

= 0.0625[1.0 + 2(0.888889 + 0.8 + 0.727273 + 0.666667 + 0.615385 
+ 0.571429 + 0.533333} + 0.5] = 0.694122. 

The exact value of the integral is I = In 2 = 0.693147. 

The errors in the solutions are the following: 

| Exact -7j | = | 0.693147 - 0.708334 | = 0.015187 

| Exact - 1 2 | = | 0.693147 - 0.697024 | = 0.003877 

| Exact - 1 3 | = | 0.693147 - 0.694122 | = 0.000975. 

Example 3.13 Evaluate I = f —^—— with 4 and 8 subintervals using the trapezium rule. 
Ji 5 + 3x 

Compare with the exact solution and find the absolute errors in the solutions. Comment on the 
magnitudes of the errors obtained. Find the bound on the errors. 

Solution With N = 4 and 8, we have the following step lengths and nodal points. 

N = 4: h = -. The nodes are 1, 1.25, 1.5, 1.75, 2.0. 

N 4 
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N = 8: h = The nodes are 1, 1.125, 1.25, 1.375, 1.5, 1.675, 1.75, 1.875, 2.0. 

N 8 

We have the following tables of values. 

N = 4: x 1.0 1.25 1.5 1.75 2.0 

fix) 0.125 0.11429 0.10526 0.09756 0.09091 


N = 8: We require the above values. The additional values required are the following, 
x 1.125 1.375 1.625 1.875 

fix) 0.11940 0.10959 0.10127 0.09412 

Now, we compute the value of the integral. 

N = 4: 7 X = J l/U) + 2 {/(1.25) + fi 1.5) + /(1.75)} + /(2.0)] 

= 0.125 [0.125 + 2 [0.11429 + 0.10526 + 0.09756} + 0.09091] 

= 0.10627. 

N = 8: I 2 = ~ 17(1) + 2{/{1.125) + fi 1.25) + /(1.375) + /(1.5) 

+ /(1.625) + fil.75) + /(1.875)} + /(2.0)] 

= 0.0625 [0.125 + 2{0.11940 + 0.11429 + 0.10959 + 0.10526 + 0.10127 
+ 0.09756 + 0.09412} + 0.09091] 

= 0.10618. 

The exact value of the integral is 


/ 


-[In 11-In 8] = 0.10615. 


The errors in the solutions are the following: 

| Exact - I x | = | 0.10615-0.10627 | = 0.00012. 
| Exact -I 2 | = | 0.10615-0.10618 | =0.00003. 

We find that | Error in I 2 \ ~ ^ \ Error in I 1 |. 

Bounds for the errors 


I Error I < (6 a)h M where M = max i f"( x) \ 

1 1 12 2 [i.2] 1/1 

1 ,,, , 3 . 18 

-, f ix) = -„ , f ix) = -„ 

5 + 3x (5 + 3x) 2 (5 + 3x) 3 


We have 


fix) — 
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h = 0.25: | Error | < ( °' 25) (0.03516) = 0.00018. 


h = 0.125: | Error | < ( °' 125) (0.03516) = 0.000046. 
1 1 12 


Actual errors are smaller than the bounds on the errors. 

fi dx 

Example 3.14 Using the trapezium rule, evaluate the integral I = J —^— -—, with 2 and 

4 subintervals. Compare with the exact solution. Comment on the magnitudes of the errors 
obtained. 

Solution With N = 2 and 4, we have the following step lengths and nodal points. 

N = 2: h = 0.5. The nodes are 0.0, 0.5, 1.0. 

N = 4: h = 0.25. The nodes are 0.0, 0.25, 0.5, 0.75, 1.0. 

We have the following tables of values. 

N= 2: x 0.0 0.5 1.0 


fix) 


0.05882 


0.1 


0.07547 


N = 4: We require the above values. The additional values required are the following. 


x 0.25 0.75 

fix ) 0.08649 0.06639 


Now, we compute the value of the integral. 


N= 2: 


I x = | 1/10.0) + 2 /(0.5) + /U.0)] 


N = 4: 


= 0.25 [0.1 + 2(0.07547) + 0.05882] = 0.07744. 

I 2 = \ 1/10.0) + 2{/(0.25) + fio.b) + /(0.75)} + /(1.0)] 

= 0.125[0.1 + 2(0.08649 + 0.07547 + 0.06639) + 0.05882] = 0.07694. 


The exact value of the integral is 



r 1 dx 
Jo (x + 3) 2 +1 



The errors in the solutions are the following: 


| Exact - ij | = | 0.07677 - 0.07744 | = 0.00067 
| Exact - Z 2 | = | 0.07677 - 0.07694 | = 0.00017. 
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We find that 

| Error in I 2 | « ^ | Error in I x \. 

Example 3.15 The velocity of a particle which starts from rest is given by the following table. 


t (sec) 

0 

2 

4 

6 

8 

10 

12 

14 

16 

18 

20 

v (ft!sec) 

0 

16 

29 

40 

46 

51 

32 

18 

8 

3 

0 


Evaluate using trapezium rule, the total distance travelled in 20 seconds. 

Solution From the definition, we have 

ds f 

v = — , or s = v dt. 
dt J 

Starting from rest, the distance travelled in 20 seconds is 

s = J v dt. 

The step length is h = 2. Using the trapezium rule, we obtain 

s = | i/io) + 2{fl2)+ m + m + m +aio>+ Am+Am 

+ /(16) + /{18)} + /(20)] 

= 0 + 2{16 + 29 + 40 + 46 + 51 + 32 + 18 + 8 + 3} + 0 = 486 feet. 


3.3.2.2 Simpson’s 1/3 Rule 

In the previous section, we have shown that the trapezium rule of integration integrates exactly 
polynomials of degree < 1, that is, the order of the formula is 1. In many science and engineering 
applications, we require methods which produce more accurate results. One such method is 
the Simpson’s 1/3 rule. 

Let the interval [a, b\ be subdivided into two equal parts with step length h = lb - a)/2. 
We have three abscissas x Q = a, x 1 = (a + b)/ 2, and x 2 = b. 

Then, P(x 0 , flx 0 )), Q(x 1 fixf ), R(x 2 , f(x, 2 )) are three points on the curve y = fix). We 
approximate the curve y = fix), a < x < b, by the parabola joining the points P, Q, R, that is, we 
approximate the given curve by a polynomial of degree 2. Using the Newton’s forward difference 
formula, the quadratic polynomial approximation to fix), interpolating at the points 
P(x 0 , f{x Q )), Q(x 1 flxf ), R(x 2 , flx 2 )), is given by 

Ax) = Ax 0 ) + \ & ~ x o) A f(x 0 ) + (x ~ x oX x ~ x 1 )A 2 f(x 0 ), 

Substituting in (3.31), we obtain 

f f(x)dx= f 2 flx)dx= f 2 r/'(x 0 ) + -i(x-x 0 )A/'(x 0 ) + ^ T (x-x 0 )(x-x 1 )A 2 /'(^o)l 0?;,:: 
Ja Jx o Jx 0 l h 2 h J 
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= (x 2 - x 0 ) fix 0 ) + ^ |^| (X - X 0 f J Af(x 0 ) + I 1 = 2hf(x 0 ) + 2hAf(x 0 ) + I x . 
Evaluating I v we obtain 

I x = ^ “ (-0 +x i)^- + w] A 2 /Xx 0 ) 

= ~^2 [ 2 ( X 2 - Xq) ~ 3(x 0 + X X )(X2 - Xq) + 6X 0 X 1 (X 2 ~ X 0 )] A 2 /Xx 0 ) 

= -x 0 )[2(x| + x 0 x 2 + Xq)-3(x 0 + x 1 )(x 2 + x 0 ) + 6x 0 x 1 ] A 2 /Xx 0 ). 

Substituting x 2 = x 0 + 2 h, x 1 = x 0 + h, we obtain 

I x = ^ [2(3xq + 6hx 0 + 4 h 2 )- 3(4 x 2 q + 6 hx 0 +2h 2 ) + 6 x 0 2 + 6Ax 0 ] A 2 /Xx 0 ) 

= ^(2A 2 )A 2 /-(x 0 ) = |a 2 /-(x 0 ). 

Hence 

J fix) dx = J 2 /‘(x) c/x = 2hfix 0 ) + 2hAfix 0 ) + ^ A 2 fix 0 ) 

= | [6/lx 0 ) + Of/lx^ - Ax 0 )} + {/(x 0 ) - 2f[x x ) + /(x 2 )}] 

= | |/(x 0 ) + 4 -fixf) + /(x 2 )] (3.39) 

In terms of the end points, we can also write the formula as 

£/Xx)c& = [/(a) + 4 f + fix 2 )j (3.40) 

This formula is called the Simpson’s 1/3 rule. 

We can also evaluate the integral fix) dx, as follows. We have 

Jx 0 

f 2 fix) dx = f 2 \fix 0 ) + (x - Xq) Af(x 0 ) + ix - X 0 )ix - x 1 )A 2 /’(x 0 )1 dx. 

Jx 0 Jx 0 L h 2h J 
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Let [(x - x Q )//i] = s. The limits of integration become: 

for x = x 0 , s = 0, and for x = x 2 , s = 2. 

We have dx-h ds. Hence, 

J 2 f{x) dx = h |V(x 0 ) + sA/Xxq) + ^ s(s - l)A 2 /Xx 0 )J ds 

m h fix o) + y A fix 0 ) + | J^y - yj A 2 /Xx 0 )j 

= h |V(* 0 ) + 2A f(x 0 ) + i AV(x o) ] 

= | [6/(x 0 ) + 6VC* X ) - /lx 0 )} + {/(x 0 ) - 2 fix x ) + fix 2 )}] 

= | \fix 0 ) + 4fix t ) + f{x 2 )l 
which is the same formula as derived earlier. 

Error term in Simpson 1/3 rule. We show that the Simpson’s rule integrates exactly poly¬ 
nomials of degree < 3. That is, using the definition of error given in (3.27), we show that 
R 2 if, x) = 0 for fix) = 1, x, x 2 , x 3 . 

Substituting fix) = 1, x, x 2 , x 3 in (3.27), we get 

fix) = 1: R 2 if, x) = J 6 dx - (6) = ib-a)-ib-a) = 0. 

fix) = x: R 2 if, x) = J xdx- ^ ^ |^a + 4 j + & j 
= |(6 2 -a 2 )- * (6 2 -a 2 ) = 0. 
fix) = x 2 : R 2 if, x) = J x 2 dx - ® ^ | a 2 + 4 + & 2 J 

= ^ ib 3 - a 3 ) - ^ ^ [a 2 + ab + b 2 ] 

= ^ ib 3 - a 3 ) - ^ (6 3 - a 3 ) = 0. 

fix) = x 3 : S 2 (f, x) = £*» dx - [a« + 4 + i»] 
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= - (6 4 - a 4 ) - —- [a 3 + a 2 b + ab 2 + b 3 ] 

4 4 

= — (b 4 - a 4 ) - — (6 4 - a 4 ) = 0. 

4 4 

Hence, the Simpson’s rule integrates exactly polynomials of degree < 3. Therefore, the 
method is of order 3. It is interesting to note that the method is one order higher than expected, 
since we have approximated fix) by a polynomial of degree 2 only. 

Let fix) = x 4 . From (3.28), we get 


c = 


\ ib 5 - a 5 ) - ^ (5a 4 + 4a 3 6 + 6 a 2 b 2 + 4ab 3 + 5b 4 ) 

5 24 

[24(6 5 - a 5 ) - 5(6 - a)(5a 4 + 4a 3 6 + 6a 2 6 2 + 4a6 3 + 56 4 )] 
- ^ ^ [6 4 - 4a6 3 + 6a 2 6 2 - 4a 3 6 + a 4 )] 


(6 - a) 5 


120 


Using (3.29), the expression for the error is given by 


W, «> - <0 * - £ 0 f m © (3.41) 

since h = (6 - a)/ 2, and a < ^ < 6. 

Since the method produces exact results, that is, R 2 (f, x) = 0, when fix) is a polynomial 
of degree < 3, the method is of order 3. 

The bound for the error is given by 

I Rif, x) I < (6 ~ a)5 M 4 = — M 4 , where M. = max | f (4) (x) \. (3.42) 

1 v 1 2880 4 90 4 4 o.< x <b 

As in the case of the trapezium rule, if the length of the interval [a, 6] is large, then 
6 - a is also large and the error expression given in (3.41) becomes meaningless. In this case, 
we subdivide [a, 6] into a number of subintervals of equal length and apply the Simpson’s 1/3 
rule to evaluate each integral. The rule is then called the composite Simpson’s 1/3 rule. 
Composite Simpson’s 1/3 rule We note that the Simpson’s rule derived earlier uses three 
nodal points. Hence, we subdivide the given interval [a, b] into even number of subintervals of 
equal length h. That is, we obtain an odd number of nodal points. We take the even number of 
intervals as 2IV. The step length is given by h = (6 - a)/(2N). The nodal points are given by 
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a = x 0 , x, = x 0 + h, x 2 = x 0 + 2h, ..., x m = x 0 + 2N h = b. 

The given interval is now written as 

^ fix)dx = \ X2N f(x)dx = J * 2 f(x)chc + J * 4 f(x)dx + ... + p X f(x)dx. 

Note that there are N integrals. The limits of each integral contain three nodal points. 
Using the Simpson’s 1/3 rule to evaluate each integral, we get the composite Simpson’s 1/3 
rule as 

\jix)dx = | [{/(*„) + 4/lx,) + fix 2 )} + \fix 2 ) + 4 fix 3 ) + fix 4 )) + ... 

+ V&ZN-^ + 4 A*2AT_l) + 

= ^ l/lx 0 ) + 4{/(x 1 ) + /lx 3 ) + ...+ /Ix^,)} + 2{f{x 2 ) + fix 4 ) + ... 



+ fix W2 )) + fix w )\ 

(3.43) 

The composite Simpson’s 1/3 rule is also of order 3. 


The error 

expression (3.34) becomes 



Rif, X) = - ^ [f (4) (5i) + f (4) (U +... + f (4) (M, 

(3.44) 

where 

x 0 , < ^, < x 2 , x 2 < < x 4 , etc. 


The bound on the error is given by 



i m, x)i4 [i f (4) <$i) m f (4) (W i+-+1 /- (4) (^at) i] 



„ Nh 5 .. ib - a)h 4 .. 

90 4 180 4 

(3.45) 

or 

| Rif, x) | < ib ~ a) 4 M 4 

1 v ’ 1 2880W 4 



where M 4 = max | f (A) (x) | and N h = ( b - a)/2. 

This expression is a true representation of the error in the Simpson’s 1/3 rule. We observe 
that as N increases, the error decreases. 

Remark 9 We have noted that the Simpson 1/3 rule and the composite Simpson’s 1/3 rule are 
of order 3. This can be verified from the error expressions given in (3.41) and (3.45). If fix) is a 
polynomial of degree < 3, then/' (4) (x) = 0. This result implies that error is zero and the composite 
Simpson’s 1/3 rule produces exact results for polynomials of degree < 3. 
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Remark 10 Note that the number of subintervals is 2 N. We can also say that the number of 
subintervals is n = 2 N and write h - (b — a)/n, where n is even. 

Example 3.16 Find the approximate value of I = f , using the Simpson’s 1/3 rule with 

Jo 1 + x 

2, 4 and 8 equal subintervals. Using the exact solution, find the absolute errors. 

Solution With n = 2 N = 2, 4 and 8, or N = 1, 2, 4 we have the following step lengths and nodal 
points. 

N = 1: h = ^ ° = j-. The nodes are 0, 0.5, 1.0. 

21V 2 

N = 2: h = \. The nodes are 0, 0.25, 0.5, 0.75, 1.0. 

21V 4 

N= 4: h = 6 “ a = i. The nodes are 0, 0.125, 0.25, 0.375, 0.5, 0.625, 0.75, 0.875,1.0. 

21V 8 

We have the following tables of values. 

n = 21V = 2: x 0 0.5 1.0 

/■(x) 1.0 0.666667 0.5 

n = 2IV = 4: We require the above values. The additional values required are the following, 
x 0.25 0.75 

fix) 0.8 0.571429 

n = 2 N = 8: We require the above values. The additional values required are the following, 
x 0.125 0.375 0.625 0.875 

fix) 0.888889 0.727273 0.615385 0.533333 

Now, we compute the value of the integral. 

n = 2N = 2: 7 X = | |/(0) + 4/(0.5) + /U.0)] 

= - [1.0 + 4(0.666667) + 0.5] = 0.674444. 

6 

n = 2N = 4: I 2 = | |/(0) + 4{/(0.25) + fi 0.75)} + 2/(0.5) + /(1.0)] 

= — [1.0 + 4 [0.8 + 0.571429} + 2(0.666667) + 0.5] = 0.693254. 

12 

n = 2N=8: I 3 = | |/(0) + 4{/(0.125) + fi 0.375) + fi 0.625) + /(0.875)} 


+ 2{/(0.25) + /(0.5) + /(0.75)} + /(1.0)] 
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= * [1.0 + 4 {0.888889 + 0.727273 + 0.615385 + 0.533333} 
24 

+ 2 {0.8 + 0.666667 + 0.571429} + 0.5] 

= 0.693155. 

The exact value of the integral is I = In 2 = 0.693147. 

The errors in the solutions are the following: 

| Exact - | = | 0.693147 - 0.694444 | = 0.001297. 

| Exact -I 2 | = | 0.693147 - 0.693254 | = 0.000107. 

| Exact -/ 3 | = | 0.693147 - 0.693155 | = 0.000008. 


Example 3.17 Evaluate / = [ -, using the Simpson’s 1/3 rule with 4 and 8 subintervals. 

Ji 5 + 3x 

Compare with the exact solution and find the absolute errors in the solutions. 


Solution With N = 2 N = 4, 8 or N = 2, 4, we have the following step lengths and nodal points. 


N= 2: h= —- = The nodes are 1, 1.25, 1.5, 1.75, 2.0. 

2N 4 

N = 4: h = = -. The nodes are 1, 1.125, 1.25, 1.375, 1.5, 1.675, 1.75, 1.875, 2.0. 

2N 8 

We have the following tables of values. 

n = 2N = 4: x 1.0 1.25 1.5 1.75 2.0 

f(x) 0.125 0.11429 0.10526 0.09756 0.09091 

n = 2N = 8: We require the above values. The additional values required are the following, 
x 1.125 1.375 1.625 1.875 

fix) 0.11940 0.10959 0.10127 0.09412 

Now, we compute the value of the integral. 

n = 2N = 4: I % « | (ftl) + 4{(1.25) + /(l.75)} + 2/U.5) + /(2.0)] 

0.25 

= — [0-125 + 4{0.11429 + 0.09756} + 2(0.10526) + 0.09091] 

= 0.10615. 

n = 2N = 8: 1 % = | l/U) + 4(/U.125) + /(1.375) + /(1.625) + /(1.875)} 


+ 2{/(1.25) + /(1.5) + /(1.75)} + ft2.0)] 
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0.125 

= [0.125 + 4(0.11940 + 0.10959 + 0.10127 + 0.09412} 

+ 2(0.11429 + 0.10526 + 0.09756} + 0.09091] 

= 0.10615. 

The exact value of the integral is I = ^ [In 11 - In 8] = 0.10615. 

The results obtained with n = 2 N = 4 and n = 2 N = 8 are accurate to all the places. 

fi dx 

Example 3.18 Using Simpson’s 1/3 rule, evaluate the integral I = — -, with 2 and 

J o x 2 + 6x + 10 

4 subintervals. Compare with the exact solution. 

Solution With n = 2 N = 2 and 4, or N = 1, 2, we have the following step lengths and nodal 
points. 

N = 1: h = 0.5. The nodes are 0.0, 0.5, 1.0. 

N = 2: h = 0.25. The nodes are 0.0, 0.25, 0.5, 0.75, 1.0. 

We have the following values of the integrand. 

n = 2N=2: x 0.0 0.5 1.0 

fix) 0.1 0.07547 0.05882 

n = 2N = 4: We require the above values. The additional values required are the following, 
x 0.25 0.75 

fix) 0.08649 0.06639 

Now, we compute the value of the integral. 

n = 2N=2: 1^ = | 1/10.0) + 4 /(0.5) + /(1.0)] 

= ° 3 5 [0.1 + 4(0.07547) + 0.05882] = 0.07678. 

n = 2N = 4: / 2 = | \fi0.0) + 4 {/(0.25) + fi 0.75)} + 2 /(0.5) + /(1.0)] 

= [0.1 + 4(0.08649 + 0.06639) + 2(0.07547) + 0.05882] = 0.07677. 

The exact value of the integral is 

/= f 1 - — o -= tan-^x + S) = tan" 1 (4)-tan' 1 (3) = 0.07677. 

Jo (x + 3) 2 +1 
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The errors in the solutions are the following: 

| Exact - Jj | pc | 0.07677 - 0.07678 | = 0.00001. 

| Exact -I 2 | = | 0.07677-0.07677 | =0.00000. 

Example 3.19 The velocity of a particle which starts from rest is given by the following table. 


t (sec) 

0 

2 

4 

6 

8 

10 

12 

14 

16 

18 

20 

v {ft!sec) 

0 

16 

29 

40 

46 

51 

32 

18 

8 

3 

0 


Evaluate using Simpson’s 1/3 rule, the total distance travelled in 20 seconds. 
Solution From the definition, we have 


ds f 

v = —, or s = v dt. 
dt J 

Starting from rest, the distance travelled in 20 seconds is 
f 20 

s = J vdt. 

The step length is h - 2. Using the Simpson’s rule, we obtain 

« = | IA0) + 4{/(2) + f{6) + /U0) + ft 14) + /U8)} + 2{/(4) + fi 8) 

+ /U2) + /U6)}+/120)] 

= | [0 + 4(16 + 40 + 51 + 18 + 3} + 2{29 + 46 + 32 + 81 + 0] 

= 494.667 feet. 

3.3.2.3 Simpson’s 3/8 Rule 

To derive the Simpson’s 1/3 rule, we have approximated fix) by a quadratic polynomial. To 
derive the Simpson’s 3/8 rule, we approximate fix) by a cubic polynomial. For interpolating by 
a cubic polynomial, we require four nodal points. Hence, we subdivide the given interval [a, b] 
into 3 equal parts so that we obtain four nodal points. Let h = (b - a)/ 3. The nodal points are 
given by 

x 0 = a, x 1 = x 0 + h, x 2 = x 0 + 2 h, x 3 = x 0 + 3 h. 

Using the Newton’s forward difference formula, the cubic polynomial approximation to 
fix), interpolating at the points 

P(x 0 , /(x 0 )), Q(x v flxf ), R(x 2 , fix 2 )), S(x 3 , fix 3 )) 


is given by 
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fix) = f[x 0 ) + * (x - x 0 ) Afix 0 ) + (x - X 0 )(x - Xj) A 2 fix 0 ) 

+ ^3 (X - x 0 )(x - x-f)(x - x 2 ) A 3 f{x 0 ). 

Substituting in (3.31), and integrating, we obtain the Simpson’s 3/8 rule as 

\ b J(x)dx = £ 3 f{x)dx = ^ |/( Xo ) + 3 f{ Xl ) + 3 fix 2 ) + fix-f] . (3.46) 

The error expression is given by 

R 3 (f, x ) = -^h 5 f«Hy=^^f W (y, x 0 <$<x 3 . (3.47) 

Since the method produces exact results, that is, R 3 (f, x) = 0, when fix) is a polynomial 
of degree < 3, the method is of order 3. 

As in the case of the Simpson’s 1/3 rule, if the length of the interval [a, b] is large, then 
b - a is also large and the error expression given in (3.47) becomes meaningless. In this case, 
we subdivide [a, b] into a number of subintervals of equal length such that the number of 
subintervals is divisible by 3. That is, the number of intervals must be 6 or 9 or 12 etc., so that 
we get 7 or 10 or 13 nodal points etc. Then, we apply the Simpson’s 3/8 rule to evaluate each 
integral. The rule is then called the composite Simpson’s 3/8 rule. For example, if we divide 
[a, b] into 6 parts, then we get the seven nodal points as 

x 0 = a, x-l = x 0 + h, x 2 = x 0 + 2 h, x 3 = x 0 + 3 h, ..., x 6 = x 0 + 6 h. 

The Simpson’s 3/8 rule becomes 

J f{x)dx = J 3 f(x)dx + J 6 f(x)dx 

= y + 3 /C*i) + 3 / W + /C*a)} + {fl* 3 ) + 3 fix 4 ) + 3 /(x 5 ) + /-(x 6 )}] 

= y bW + 3 /C*i) + 3 + 2 A^ 3 ) + 3 ^ 4 ) + 3 fix 5 ) + /(t 6 )] 

The error in this composite Simpson’s 3/8 rule becomes 

= X 0 <^<X 3 ,X3<^ 2 <X 6 . (3.48) 

In the general case, the bound for the error expression is given by 
| R(f,x) | <Ch A M A 

M 4 = max |/- (4) (x)|. 


where 
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If fix) is a polynomial of degree < 3, then / (4) (x) = 0. This result implies that error 
expression given in (3.47) or (3.48) is zero and the composite Simpson’s 3/8 rule produces exact 
results for polynomials of degree < 3. Therefore, the formula is of order 3, which is same as the 
order of the Simpson’s 1/3 rule. 

Remark 11 In Simpson’s 3/8th rule, the number of subintervals is n = 3N. Hence, we have 


where n is a multiple of 3. 


Remark 12 Simpson’s 3/8 rule has some disadvantages. They are the following: ( i ) The number 
of subintervals must be divisible by 3. iii) It is of the same order as the Simpson’s 1/3 rule, 
which only requires that the number of nodal points must be odd. iiii) The error constant c in 
the case of Simpson’s 3/8 rule is c = 3/80, which is much larger than the error constant c = 1/90, 
in the case of Simpson’s 1/3 rule. Therefore, the error in the case of the Simpson’s 3/8 rule is 
larger than the error in the case Simpson 1/3 rule. Due to these disadvantages, Simpson’s 3/8 
rule is not used in practice. 


Example 3.20 Using the Simpson’s 3/8 rule, evaluate I = -—— with 3 and 6 subintervals. 

Ji 5 + 3x 

Compare with the exact solution. 

Solution With n = 3 N = 3 and 6, we have the following step lengths and nodal points. 


n = 3N = 3: h = —- = - . The nodes are 1, 4/3, 5/3, 2.0. 

3N 3 

n = 3N=6: h= The nodes are 1, 7/6, 8/6, 9/6, 10/6, 11/6, 2.0 

We have the following tables of values. 

n = 3N=3: x 1.0 4/3 5/3 2.0 

fix) 0.125 0.11111 0.10000 0.09091 

n = 3 N = 6: We require the above values. The additional values required are the following, 
x 7/6 9/6 11/6 

fix) 0.11765 0.10526 0.09524 

Now, we compute the value of the integral. 

n = 3N = 3: 7g = ^ [/(l) + 3 fi 4/3) + 3 fi5/3) + fi 2.0)] 

= 0.125[0.125 + 3(0.11111 + 0.10000} + 0.09091] = 0.10616. 
n = 3N = 6: 4 = ^ OTD + 3{/(7/6) + fi 8/6) + /(10/6) + /(11/6)} 


+ 2 /(9/6)} + /(2.0)] 
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= [0.125 + 3 {0.11765 + 0.11111 + 0.10000 + 0.09524} 

+ 2(0.10526) + 0.09091] = 0.10615. 

The exact value of the integral is I = ^ [log 11 - log 8] = 0.10615. 

The magnitude of the error for n = 3 is 0.00001 and for n = 6 the result is correct to all 
places. 

3.3.2.4 Romberg Method (Integration) 

In order to obtain accurate results, we compute the integrals by trapezium or Simpson’s rules 
for a number of values of step lengths, each time reducing the step length. We stop the compu¬ 
tation, when convergence is attained (usually, the magnitude of the difference in successive 
values of the integrals obtained by reducing values of the step lengths is less than a given 
accuracy). Convergence may be obtained after computing the value of the integral with a number 
of step lengths. While computing the value of the integral with a particular step length, the 
values of the integral obtained earlier by using larger step lengths were not used. Further, 
convergence may be slow. 

Romberg method is a powerful tool which uses the method of extrapolation. 

We compute the value of the integral with a number of step lengths using the same 
method. Usually, we start with a coarse step length, then reduce the step lengths and re¬ 
compute the value of the integral. The sequence of these values converges to the exact value of 
the integral. Romberg method uses these values of the integral obtained with various step 
lengths, to refine the solution such that the new values are of higher order. That is, as if the 
results are obtained using a higher order method than the order of the method used. The 
extrapolation method is derived by studying the error of the method that is being used. 

Let us derive the Romberg method for the trapezium and Simpson’s rules. 

Romberg method for the trapezium rule 
Let the integral 

/ = ^ f{x)dx 

be computed by the composite trapezium rule. Let I denote the exact value of the integral 
and I T denote the value obtained by the composite trapezium rule. 

The error, I - I T , in the composite trapezium rule in computing the integral is given by 
I -I T = c-Ji 2 + cJi A + c 3 h e + ... 

or I = I T + Cl h 2 + cJi A + c 3 A 6 + ... (3.49) 

where c 1 , c 2 , c 3 , ... are independent of h. 

To illustrate the extrapolation procedure, first consider two error terms. 

I = I T + c x h 2 + cJi A . 


(3.50) 
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Let I be evaluated using two step lengths h and qh, 0 < q < 1. Let these values be 
denoted by I T (h) and I T (qh). The error equations become 


I = I^h) + c x h 2 + cji 4 . (3.51) 

I = Ijlqh) + Cl q 2 h 2 + c# 4 h 4 . (3.52) 

From (3.51), we obtain 

I-I 1 {h) = c 1 h 2 + c 2 h i . (3.53) 

From (3.52), we obtain 

/ - I T (qh) = Cl q 2 h 2 + c 2 q 4 h 4 . (3.54) 

Multiply (3.53) by q 2 to obtain 

q 2 [I - I T (h)] = c x q 2 h 2 + c 2 q 2 h A . (3.55) 

Eliminating c x q 2 h 2 from (3.54) and (3.55), we obtain 


(1 - q 2 )I - I T (qh) + q 2 I^h) = c# 2 h\q 2 - 1). 
Solving for /, we obtain 


t I T (qh)-q 2 I T (h) 

Note that the error term on the right hand side is now of order 0(h 4 ). 

Neglecting the 0(h 4 ) error term, we obtain the new approximation to the value of the 
integral as 


T a) (h) I T (qh)-q 2 I T (h) 
Z ~ ,T<W= (1-q 2 ) 


(3.56) 


We note that this value is obtained by suitably using the values of the integral obtained 
with step lengths h and qh, 0 < q <1. This computed result is of order, 0(h 4 ), which is higher 
than the order of the trapezium rule, which is of 0(h 2 ). 

For q = 1/2, that is, computations are done with step lengths h and h! 2, the formula 
(3.56) simplifies to 




i T (hJ2)-m)i T (h) 

1-0/4) 


AI T (hJ2)-I T (h) AI T (hJ2)-I T (h) tocn . 

=-TT- =-3- ' (3 ' 57> 

In practical applications, we normally use the sequence of step lengths h, hi2, h/2 2 , h/2 3 , ... 

Suppose, the integral is computed using the step lengths h, h/2, h/2 2 . Using the results 
obtained with the step lengths h/2, h/2 2 , we get 
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lft’{hJ2) » 


I T {hJA) - (1/4) Z r (A/2) 
1- (1/4) 


4 Z r (A/4) - I T (h/ 2) __ 4 I T (h/4) - I T (h/2) 
4-1 " 3 


(3.58) 


Both the results/^(A), I ft 1 (A/2) are of order, 0(A 4 ). Now, we can eliminate the 0(A 4 ) 
terms of these two results to obtain a result of next higher order, 0(A 6 ). The multiplicative 
factor is now (1/2) 4 = 1/16. The formula becomes 


r(2)f ,. 161ft’ (A/2) - ift’(h) 16 Ift’ (A/2) - 1 ft 

It iK) ~ -WTI- = -15- 

Therefore, we obtain the Romberg extrapolation procedure 


4 m /r m ~ 1) (A/2) - lft ri ~ 1 ’{h) 
4 m - 1 


= 1 , 2 , ... 


(3.60) 


where I ft’ (A) = I T (A). 

The computed result is of order 0(A 2m+2 ). 

The extrapolations using three step lengths A, A/2, A/2 2 , are given in Table 3.1. 


Table 3.1. Romberg method for trapezium rule. 


Step 

Value of I 

Value of I 

Value of I 

Length 

0(h 2 ) 

0(h 4 ) 

0(h 6 ) 

h 

/(A) 

/( l) (/l) 4/(A/2)-/(A) 


A/2 

/(A/2) 

lWw2)= mm)-iw2) 

7 (2) (A) _16/ a) (A/2)-/ a) (A) 

A/4 

/(A/4) 




Note that the most accurate values are the values at the end of each column. 

Romberg method for the Simpson’s 1/3 rule We can apply the same procedure as in trape¬ 
zium rule to obtain the Romberg’s extrapolation procedure for the Simpson’s 1/3 rule. 

Let I denote the exact value of the integral and I s denote the value obtained by the 
composite Simpson’s 1/3 rule. 
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The error, I — 7 g , in the composite Simpson’s 1/3 rule in computing the integral is given by 
I-I s = c 1 h 4 + c 2 h 6 + c 3 h 8 + ... 

or I = 7 g + c-Ji 4 + cJi G + c 3 h 8 + ... (3.61) 

As in the trapezium rule, to illustrate the extrapolation procedure, first consider two 
error terms. 

7 = / s + Cl h A + c 2 h e . (3.62) 

Let 7 be evaluated using two step lengths h and qh, 0 < q < 1. Let these values be 
denoted by I s (h ) and I s (qh). The error equations become 

7 = I s (h) + c-Ji 4 + c 2 h e . (3.63) 

7 = I s (qh) + c t q 4 h 4 + c 2 q 6 h 6 . (3.64) 

From (3.63), we obtain 

7 - I s (h) = c-Ji 4 + cji e . (3.65) 

From (3.64), we obtain 

7 - I s (qh) = c x q A h A + c$ 6 h 6 . (3.66) 

Multiply (3.65) by q 4 to obtain 

q 4 U - I s (h)] = c x q 4 h 4 + ctf 4 h 6 . (3.67) 

Eliminating c^h 4 from (3.66) and (3.67), we obtain 

(1 - q 4 )I - I s (qh ) + q 4 I s (h ) = Ctf 4 h e (q 2 - 1). 

Note that the error term on the right hand side is now of order 0(h 6 ). Solving for 7, we 

obtain 


I s (qh)-q 4 l s (h) c 2 q 4 

(1-a l+q 2 

Neglecting the 0(h 6 ) error term, we obtain the new approximation to the value of the 
integral as 


S (l-g 4 ) 


(3.68) 


Again, we note that this value is obtained by suitably using the values of the integral 
obtained with step lengths h and qh, 0 < q < 1. This computed result is of order, Oih 6 ), which 
is higher than the order of the Simpson’s 1/3 rule, which is of 0(h 4 ). 

For q = 1/2, that is, computations are done with step lengths h and h/2, the formula 
(3.68) simplifies to 


7 ®(« = 


I s (h/2) - (1/16) I s Ui) 


1-0/16) 
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16 I s (h/2) - I s (h ) _ 16 I s (h/2) - I s (h ) 

= 16--1 = 15 ' <3 69) 

In practical applications, we normally use the sequence of step lengths h, hi2, hi 2 2 , 
h/2 3 , ... 

Suppose, the integral is computed using the step lengths h, h! 2, h/2 2 . Using the results 
obtained with the step lengths h/2, h/2 2 , we get 

r (i> (hm _ i s WA)-ms)i s W2) 
s 1-(1/16) 


_ 16 I s (h/4) - I s (hJ2) _ 16I s (hJ4) - I s (h/2) 

16-1 15 

Both the results iftHh), I^P (h/2) are of order, 0(h 6 ). Now, we can eliminate the 0(h 6 ) 
terms of these two results to obtain a result of next higher order, 0(h 8 ). The multiplicative 
factor is now (1/2) 6 = 1/64. The formula becomes 

t( 2)/7 \ 64 647g 1> (/i/2) - Ijp(h) 

{h) = - 63 • (3 - 71) 

Therefore, we obtain the Romberg extrapolation procedure for the composite Simpson’s 
1/3 rule as 


4 m + lWm-l) (/l/2) _ Jim-1) {h) 


(3.72) 


where 7g 0) (A) = I s (h). 

The computed result is of order 0(h 2m+i ). 

The extrapolations using three step lengths h, h/2, h/2 2 , are given in Table 3.2. 


Table 3.2. Romberg method for Simpson’s 1/3 rule. 


Step 

Value of I 

Value of I 

Value of I 

Length 

O/h 4 ) 

0(h 6 ) 

om 

h 

1(h) 

/( l) (A) lQKhl 2) - 1(h) 


h/2 

I(h/2) 

16Z(A/4) - I(hJ2) 

/2 ) (W _ 64/ (1) W2)-7 (1) (/r) 

h !4 

I(h/4) 
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Note that the most accurate values are the values at the end of each column. 

Example 3.21 The approximations to the values of the integrals in Examples 3.12 and 3.13 
were obtained using the trapezium rule. Apply the Romberg’s method to improve the 
approximations to the values of the integrals. 

Solution In Example 3.12, the given integral is 
r 1 dx 


f A 

Jo 1 + 


The approximations using the trapezium rule to the integral with various values of the 
step lengths were obtained as follows. 

h = 1/2, N = 2: 1 = 0.708334; h = 1/4, N = 4:1 = 0.697024. 
h = 1/8, N = 8 :1 = 0.694122. 


We have 


7 a) ( 1 / 2 ) = 


47(1/4)-7(1/2) 4(0.697024) - 0.708334 


0.693254 


7® (1/2) = 167 1 (1/4) - 7 1 (1/2) = 16(0.693155)-0.693254 = 0 69314g 
15 15 

The results are tabulated in Table 3.3. 

Magnitude of the error is 

| 7 - 0.693148 | = | 0.693147 - 0.693148 | = 0.000001. 

Table 3.3. Romberg method. Example 3.21. 


Step 

Length 

Value of I 

om 

Value of I 

om 

Value of I 

om 

1/2 

0.708334 





0.693254 


1/4 

0.697024 


0.693148 



0.693155 


1/8 

0.694122 






In Example 3.13, the given integral is 
dx 

5 + 3*' 

The approximations using the trapezium rule to the integral with various values of the 
step lengths were obtained as follows. 

h = 1/4, N = 4: 7 = 0.10627; h = 1/8, N = 8: 7 = 0.10618. 
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We have 7 (1) (l/4) = 


4/0/8)-7Q/4) 
3 


4(010618) - 0.10627 =Q1Q615 
3 


Since the exact value is I = 0.10615, the result is correct to all places. 

Example 3.22 The approximation to the value of the integral in Examples 3.16 was obtained 
using the Simpson’s 1/3 rule. Apply the Romberg’s method to improve the approximation to the 
value of the integral. 

Solution In Example 3.16, the given integral is 
r 1 dx 

~ Jo 1+ x' 

The approximations using the Simpson’s 1/3 rule to the integral with various values of 
the step lengths were obtained as follows. 

h = V2,n = 2N = 2:I = 0.694444; h = 1/4, n = ZN = 4:1 = 693254; 
h = 1/8, n = 2N = 8: 1 = 693155. 


We have 


/(1) = 167(1/4) -7(1/2) = 16 (0.693254) -0,694444 = ^ 

15 15 

/(1)(1/4) _ 167(1/8) -7(1/4) _ 16 (0.693155) - 0.693254 _ Q 69314g 


/(2) = 647 (1) Q/4)-7 (1) Q/2) = 64(0,693148)-0.693175 = 693148 

63 63 

The results are tabulated in Table 3.4. 

Magnitude of the error is 

| 7 - 0.693148 | = | 0.693147 - 0.693148 | = 0.000001. 

Table 3.4. Romberg method. Example 3.22. 


Step 

Length 

Value of I 

om 

Value of I 

0(h 6 ) 

Value of I 

om 

1/2 

0.694444 





0.693175 


1/4 

0.693254 


0.693148 



0.693148 


1/8 

0.693155 
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| REVIEW QUESTIONS 


1. What is the order of the trapezium rule for integrating J fix)dx ? What is the expres¬ 
sion for the error term? 

Solution The order of the trapezium rule is 1. The expression for the error term is 
Error = - where a<t,<b. 

2. When does the trapezium rule for integrating J f{x)dx gives exact results? 

Solution Trapezium rule gives exact results when fix) is a polynomial of degree < 1. 

3. What is the restriction in the number of nodal points, required for using the trapezium 

rule for integrating J f(x)dx ? 

Solution There is no restriction in the number of nodal points, required for using the 
trapezium rule. 

rb 

4. What is the geometric representation of the trapezium rule for integrating f(x)dx ? 

Solution Geometrically, the right hand side of the trapezium rule is the area of the 
trapezoid with width b - a, and ordinates/(a) and fib), which is an approximation to the 
area under the curve y = fix) above the x-axis and the ordinates x = a, and x-b. 

rb 

5. State the composite trapezium rule for integrating f(x)dx , and give the bound on the 
error. 

Solution The composite trapezium rule is given by 

ffMdx = | l/lx 0 ) + 2{flx 1 ) +/(x 2 ) + ...+fix n _ 1 )}+fix n )l 
where nh = {b - a). The bound on the error is given by 


, „ | . nh 3 ,, ib-a)hr 

Error <-M,, =- 

1 1 12 2 12 


M 2 


where M 2 = max | f" (x) | and nh = b - a. 

6. What is the geometric representation of the composite trapezium rule for integrating 
jjix)dx? 

Solution Geometrically, the right hand side of the composite trapezium rule is the sum 
of areas of the n trapezoids with width h, and ordinates fix^f) and fixf i = 1,2 ,..., n. This 
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sum is an approximation to the area under the curve y = fix ) above the x-axis and the 
ordinates x = a and x = b. 

7. How can you deduce that the trapezium rule and the composite trapezium rule produce 
exact results for polynomials of degree less than or equal to 1? 

Solution The expression for the error in the trapezium rule is given by 

R 1 (f,x) = -^f'%) 

and the expression for the error in the composite trapezium rule is given by 

R& x )=- ^ my+ny +...+ny i, <m y 

If/lx) is a polynomial of degree < 1, then/""lx) = 0- This result implies that error is zero 
and the trapezium rule produces exact results for polynomials of degree < 1. 

8. When does the Simpson’s 1/3 rule for integrating J f(x)dx gives exact results? 
Solution Simpson’s 1/3 rule gives exact results when fix) is a polynomial of degree < 3. 


9. What is the restriction in the number of nodal points, required for using the Simpson’s 
1/3 rule for integrating J f{x)dx ? 

Solution The number of nodal points must be odd for using the Simpson’s 1/3 rule or 
the number of subintervals must be even. 


10. State the composite Simpson’s 1/3 rule for integrating J f(x)dx, and give the bound on 
the error. 

Solution Let n = 2 N be the number of subintervals. The composite Simpson’s 1/3 rule 
is given by 

J f(x)dx = ^ [{/lx 0 ) + 4/lx 1 ) + fix 2 )} + \fix 2 ) + 4/lx 3 ) + /(x 4 )} + ... 


+ I 'fbc W -2) + 4 A* 2 at - i ) + 


= 3 i/ko>+ 4 w+/y> + -+ 

+ 2{/(x 2 ) + /(x 4 ) + ... + fix m J) + frx m )\ 

The bound on the error is given by 

I Rif, x) | < ^ [| f w i^) |+1 f w iy i+...+1 f w iy) i] 

^ Nh 5 .. ib - a)h 4 ,. 

<- M a = - M. 

90 4 


180 
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where x 0 < ^ < x 2 , x 2 < t; 2 < x 4 , etc., M 4 = max, | f (4) (x) | and N h = (b - a)/ 2. 

11. How can you deduce that the Simpson’s 1/3 rule and the composite Simpson’s 1/3 rule 
produce exact results for polynomials of degree less than or equal to 3? 

Solution The expression for the error in the Simpson’s 1/3 rule is given by 

m x) = fj f w ©=- /■“©=- £ f w © 

where h = (b - a)/ 2, and a <t,<b. 

The expression for the error in the composite Simpson’s 1/3 rule is given by 

W *) = - ^ V w (t, i) + f w <Z 2 > + ■■■ + /■ (4) (^)] 

where x 0 < t, 4 < x 2 , x 2 < ^ 2 < x 4 , etc. 

If fix) is a polynomial of degree < 3, then f A) (x) = 0. This result implies that error is zero 
and the Simpson 1/3 rule produces exact results for polynomials of degree < 3. 

12. What is the restriction in the number of nodal points, required for using the Simpson’s 

3/8 rule for integrating J f(x)dx ? 

Solution The number of subintervals must be divisible by 3. 

13. What are the disadvantages of the Simpson’s 3/8 rule compared with the Simpson’s 1/3 
rule? 

Solution The disadvantages are the following: (i) The number of subintervals must be 
divisible by 3. (ii) It is of the same order as the Simpson’s 1/3 rule, which only requires 
that the number of nodal points must be odd. (m) The error constant c in the case of 
Simpson’s 3/8 rule is c = 3/80, which is much larger than the error constant c = 1/90, in 
the case of Simpson’s 1/3 rule. Therefore, the error in the case of the Simpson’s 3/8 rule 
is larger than the error in the case Simpson 1/3 rule. 

14. Explain why we need the Romberg method. 

Solution In order to obtain accurate results, we compute the integrals by trapezium 
or Simpson’s rules for a number of values of step lengths, each time reducing the step 
length. We stop the computation, when convergence is attained (usually, the magnitude 
of the difference between successive values of the integrals obtained with the reducing 
values of the step lengths is less than a given accuracy). Convergence may be obtained 
after computing the value of the integral with a number of step lengths. While computing 
the value of the integral with a particular step length, the values of the integral obtained 
earlier by using larger step lengths were not used. Further, convergence may be slow. 
Romberg method is a powerful tool which uses the method of extrapolation. Romberg 
method uses these computed values of the integrals obtained with various step lengths, 
to refine the solution such that the new values are of higher order. That is, as if they are 
obtained using a higher order method than the order of the method used. 
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15. An integral 7 is evaluated by the trapezium rule with step lengths A and qh. Write the 
Romberg method for improving the accuracy of the value of the integral. 

Solution Let Ijih), I T (qh) denote the values of the integral evaluated using the step 
lengths A and qh. The required Romberg approximation is given by 

i. I p w =kMt^lkW. 

(1 -q 2 ) 

16. An integral 7 is evaluated by the composite trapezium rule with step lengths h, hi 2, hi 

2 2 , h/2 m .Write the Romberg method for improving the accuracy of the value of 

the integral. 

Solution The required Romberg approximation is given by 


n m - 1> (hJ2) ~ 1^ 

4 m - 1 


- 1) (« 


1 , 2 , ... 


where 7y 0) (A) = I T (h). 

17. An integral 7 is evaluated by the Simpson’s 1/3 rule with step lengths h and qh. Write 
the Romberg method for improving the accuracy of the value of the integral. 

Solution Let 7 g (A), I s (qh) denote the values of the integral evaluated using the step 
lengths h and qh. The required Romberg approximation is given by 

7~7< 1) {h)= hW)- q %{h) ' 
s (1-g 4 ) 

18. An integral 7 is evaluated by the composite Simpson’s 1/3 rule with step lengths h, hi 2, 
A/2 2 , ..., A/2 m , ... . Write the Romberg method for improving the accuracy of the value of 
the integral. 

Solution The required Romberg approximation is given by 


1) (A/2)-4 m - 1) (A) 


where 7 g 0) (A) = 7 g (A), m = 1, 2, ... 


- f EXERCISE 3.2 ) - 

1. Evaluate f — by trapezium rule, dividing the range into four equal parts. 

Jl/2 X 

(At/. May I June 2006) 

2. Using the trapezium rule, find [ f{x)dx , from the following set of values of x and fix). 

Jo 


X 

0 

1 

2 

3 

4 

5 

6 

fix) 

1.56 

3.64 

4.62 

5.12 

7.05 

9.22 

10.44 
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3. Using the trapezium rule, evaluate sin x dx by dividing the range into 6 equal 

intervals. (A.U. Nov. / Dec. 2004) 

4. Using the trapezium rule, evaluate J sin x dx with h = 0.5. 

5. The velocity of a particle which starts from rest is given by the following table. 


t (sec) 

0 

2 

4 

6 

8 

10 

12 

14 

16 

18 

v (ft/sec) 

0 

12 

16 

26 

40 

44 

25 

12 

5 

0 


Evaluate using trapezium rule, the total distance travelled in 18 seconds. 


6. Using the trapezium rule, evaluate f 

J-i 1 + x 


taking 8 intervals. (A. U. April/May 2004) 


7. Using the Simpson’s 1/3 rule, evaluate f x e x dx taking four intervals. Compare the 

Jo 

result with actual value. 

8. Evaluate e x dx using the Simpson’s rule with h = 1 and h = 1/2. Compare with exact 
solution. Improve the result using Romberg integration. 

f 6 dx 

9. Evaluate J q — 2 by (t) trapezium rule, (ii) Simpson’s rule. Also, check the result by 

actual integration. (A. TJ. Nov. / Dec. 2004) 

10. Compute 

r 1 x p 

I = —;- dx for p = 0, 1 

p Jo x 3 + 10 

using trapezium rule and Simpson’s 1/3 rule with the number of points 3, 5 and 9. 
Improve the results using Romberg integration. 

11. For the given data 


* 

0.7 

0.9 

1.1 

1.3 

1.5 

1.7 

1.9 

2.1 

fix) 

0.64835 

0.91360 

1.16092 

1.36178 

1.49500 

1.35007 

1.52882 

1.44573 


use Simpson’s 1/3 rule for first six intervals and trapezium rule for the last interval to 
<■ 2.1 

evaluate fix) dx. Also, use trapezium rule for the first interval and Simpson’s 1/3 
Jo.7 


rule for the rest of intervals to evaluate f fix) dx. Comment on the obtained results 
Jo.7 

by comparing with the exact value of the integral, which is equal to 1.81759. 

(A.U. April/May 2003) 
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12. Evaluate [ -by Simpson’s 1/3 rule and hence find the value of log 5, (n = 10). 

Jo Ax + 5 

(A. U. April /May 2005) 

13. By dividing the range into ten equal parts, evaluate sin x dx by trapezium rule and 
Simpson’s rule. Verify your answer with integration. 

( A.U. May I June 2006 ; A.U. Nov. I Dec. 2006) 

14. Using Simpson’s 3/8th rule, evaluate f by dividing the range into six equal 

Jo 1 + x 

parts. (A.U. Nov. / Dec. 2004) 

3.3.3 Integration Rules Based on Non-uniform Mesh Spacing 

We have defined the general integration rule as 

/ = J w(x) fix) dx='^X k f(x k ) 

“ k = 0 

= X 0 f{x 0 ) + ^flxf) + X 2 f{x 2 ) + ... + k n flx n ). (3.73) 

When the abscissas are prescribed and are equispaced, that is, x i =x Q + ih, i = 1, 2. n, 

we have derived the trapezium and Simpson’s rules (Newton-Cotes formulas). When the 
abscissa are not prescribed in advance and they are also to be determined, then the formulas 
using less number of abscissas can produce higher order methods compared to the Newton- 
Cotes formulas. Such formulas are called Gaussian integration rules or formulas. 

Gaussian integration rules can be obtained when the limits are finite or one of the 
limits is infinite or both the limits are infinite. 

We have the following Gaussian integration rules depending on the limits of integra¬ 
tion and on the expression for the weight function w(x). 

1. Gauss-Legendre integration rules 

Limits of integration = [- 1, 1], Weight function = w{x) = 1. 

Abscissas = Zeros of the corresponding Legendre polynomial. 

2. Gauss-Chebychev integration rules 

Limits of integration = [- 1, 1], Weight function = w(x) = ll-Jl-x 2 . 

Abscissas = Zeros of the corresponding Chebychev polynomial. 

3. Gauss-Laguerre integration rules 

Limits of integration = [0, °°]. Weight function = w(x) = e~ x . 

Abscissas = Zeros of the corresponding Laguerre polynomial. 

4. Gauss-Hermite integration rules 

Limits of integration = (- °°). Weight function = w(x) = e~ x . Abscissas = Zeros of the 

corresponding Hermite polynomial. 
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For our discussion and derivation, we shall consider only the Gauss-Legendre integra¬ 
tion rules. As per the terminology used in syllabus, we shall call these formulas as Gaussian 
formulas. 

3.3.3.1 Gauss-Legendre Integration Rules 

Since the weight function is w{x) = 1, we shall write the integration rule as 

/ = JV(*) dx = X Q f(x 0 ) + X 1 f(x 1 ) + X 2 f(x 2 ) + ... + Kf(x n ). (3.74) 

As mentioned earlier, the limits of integration for Gauss-Legendre integration rules 
are [- 1, 1]. Therefore, we transform the limits [a, b] to [- 1, 1], using a linear transformation. 
Let the transformation be x=pt + q. 

When x = a, we have t = - 1: a = - p + q. 

When x = b, we have t = 1: b = p + q. 

Solving, we get p(b - a)/ 2, q = (b + a)/ 2. 

The required transformation is x m A [(6 - a)t + (b + a)]. (3.75) 

Then, fix) = /T[(fo - a)t + {b + a)]/2} and dx = [(6 - a)/2]dt. 

The integral becomes 

I = ^ fix) dx = / ji [(6 - a)t + (b + a)]| ji (b - a)| dt = g(t) dt (3.76) 

where g(t) = |— (^ _ a )| f | 2 Vi> ~ a )t + (b + a)]|. 

Therefore, we shall derive formulas to evaluate r, g(t) dt . 

Without loss of generality, let us write this integral as J ^ fix) dx . 

The required integration formula is of the form 

£/(*) dx = X 0 f{x 0 ) + X 1 fe 1 ) + X 2 f{x 2 ) + ... + x n fix n ). (3.77) 

We shall follow the approach of method of undetermined coefficients to derive the 
formulas. 

Before deriving the methods, let us remember the definition of the order of a method 
and the expression for the error of the method. 

An integration method of the form (3.77) is said to be of order p, if it produces exact 
results, that is error R n = 0, for all polynomials of degree less than or equal to p. That is, it 

produces exact results for fix) = 1, x, x 2 , ..., x p . When w(x) = 1, this implies that 
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R n (x m ) = J x m dx - ^ X k x™ = 0, for m = 0, 1, 2, p. 

-1 k = 0 

The error term is obtained for f{x) = x p+1 . We define 

c= \\x^dx-£x k xr 

1 k = 0 

where c is called the error constant. Then, the error term is given by 
«„</) = J‘ f(x)dx - 


a<i<b 

If R n lx p+1 ) also becomes zero, then the error term is obtained for fix) = x p+2 . 

Gauss one point rule (Gauss-Legendre one point rule) 

The one point rule is given by 

[/(xldx = X 0 fl Xo ) 

where X 0 0. The method has two unknowns A 0 , x 0 . Making the formula exact for fix) = 
get 

fix) = 1: J dx = 2 = X 0 . 

fix) = x: J xdx = 0 = A, 0 x 0 . 

Since, A, 0 * 0, we get x 0 = 0. 

Therefore, the one point Gauss formula is given by 
J 1 f(x)dx = 2 /(O). 

Error of approximation 

The error term is obtained when fix) = x 2 . We obtain 

f 1 9 2 

c = J ^ x 2 dx - 0 = —. 

The error term is given by. 


(3.78) 


(3.79) 


(3.80) 
l,x, we 


(3.81) 


(3.82) 
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Remark 13 Since the error term contains f"(Q , Gauss one point rule integrates exactly poly¬ 
nomials of degree less than or equal to 1. Therefore, the results obtained from this rule are 
comparable with the results obtained from the trapezium rule. However, we require two 
function evaluations in the trapezium rule whereas we need only one function evaluation in 
the Gauss one point rule. If better accuracy is required, then the original interval [a, b\ can be 
subdivided and the limits of each subinterval can be transformed to [- 1, 1]. Gauss one point 
rule can then be applied to each of the integrals. 

Gauss two point rule (Gauss-Legendre two point rule) 

The two point rule is given by 


1 

fix)dx = \fix 0 ) + \fixf 

(3.83) 

where A 0 ^ 0, A, 1 ^ 0 and x 0 ^ x r The method has four unknowns A 0 , x Q 
formula exact for fix) = 1, x, x 2 , x 3 , we get 

, A 1; x r Making the 

fix) = 1: 

J_ i dx = 2 = X 0 + ^ 1 . 

(3.84) 

fix) = x: 

J xdx = 0 = AgXg + AjX^ 

(3.85) 

fix) = x 2 : 

J x * 2 dx = | = AqXq 2 + A^ 2 . 

(3.86) 

fix) = x 3 : 

J x 3 dx = 0 = AqXq 3 + AjX-, 3 . 

(3.87) 


Eliminating A 0 from (3.85) and (3.87), we get 

- = 0, or - XqXx-l + x 0 ) = 0- 


Now, ^ 0 and x 0 =£ x r Hence, = 0, or x 1 = - x 0 . If x 1 = 0, (3.85) gives x 0 = 0, which is 
not possible. Therefore, x 1 = - x 0 . 

Substituting in (3.85), we get A 0 - = 0, or A 0 = A r 

Substituting in (3.84), we get A 0 = ^ = 1. 


Substituting in (3.86), we get 


2 1 ^ 1 

x 0 =-, or x 0 =±-j= = - Xl . 


Therefore, the two point Gauss rule (Gauss-Legendre rule) is given by 




(3.88) 
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Error of approximation 

The error term is obtained when fix) = x 4 . We obtain 



2 _ 2 __ 8 _ 
5 9 ~ 45 ‘ 


The error term is given by 




(3.89) 


Remark 14 Since the error term contains f (4 X,q), Gauss two point rule integrates exactly 
polynomials of degree less than or equal to 3. Therefore, the results obtained from this rule 
are comparable with the results obtained from the Simpson’s rule. However, we require three 
function evaluations in the Simpson’s rule whereas we need only two function evaluations in 
the Gauss two point rule. If better accuracy is required, then the original interval [a, b\ can be 
subdivided and the limits of each subinterval can be transformed to [- 1, 1]. Gauss two point 
rule can then be applied to each of the integrals. 

Gauss three point rule (Gauss-Legendre three point rule) 

The three point rule is given by 


fJix)dx = X 0 fix 0 ) + XJixf + X 2 fix 2 ) 


(3.90) 


where A 0 * 0, ^ ^ 0, X 2 * 0, and x 0 * x 1 * x 2 . The method has six unknowns X 0 , x 0 , A^, x v X 2 , x 2 
Making the formula exact for fix) = 1, x, x 2 , x 3 , x 4 , x 5 , we get 



(3.92) 


(3.91) 


fix) = x 2 : 



(3.93) 



(3.94) 


fix) = x 4 : 



(3.95) 



Solving this system as in the two point rule, we obtain 



(3.96) 
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Therefore, the three point Gauss rule (Gauss-Legendre rule) is given by 

Error of approximation 

The error term is obtained when fix) = x e . We obtain 

H 

The error term is given by 


-IT ♦•♦■(£ 




-1< ^ < i. 


Remark 15 Since the error term contains f^XQ, Gauss three point rule integrates exactly 
polynomials of degree less than or equal to 5. Further, the error coefficient is very small 
(1/15750 = 0.00006349). Therefore, the results obtained from this rule are very accurate. We 
have not derived any Newton-Cotes rule, which can be compared with the Gauss three point 
rule. If better accuracy is required, then the original interval [a, b ] can be subdivided and the 
limits of each subinterval can be transformed to [- 1, 1]. Gauss three point rule can then be 
applied to each of the integrals. 


Example 3.23 Evaluate the integral I = - -r dx, using Gauss one point, two point and 

1 + x 

three point rules. Compare with the exact solution I = tan -1 (4) - (ji/4). 

Solution We reduce the interval [1, 2] to [- 1, 1] to apply the Gauss rules. 

Writing x = at + b, we get 

1 = - a + 6, 2 = a + 6. 

Solving, we get a = 1/2, b = 3/2. Therefore, x = (t + 3)/2, dx = dt/2. 

The integral becomes 


■ti 


8 it + 3) 


- dt 


J-i[16 + (/ + 3) 4 ] 
where fit) = 8(/ + 3)/[16 + (/ + 3) 4 ], 

Using the one point Gauss rule, we obtain 


=\[ i md 


1 = 2 


r 24 1 48 
= 2 [l6 + 8lj = 97 = 0-4 


Using the two point Gauss rule, we obtain 


I = f \ - \ + f I -jgr j = fi- 0.577350) + /(0.577350) 


Us 


= 0.384183 + 0.159193 = 0.543376. 
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Using the three point Gauss rule, we obtain 

; 4K-i) +w+v (l| 

■ | [5 ft- 0.774597) + 8 flff) + 5/10.774597)] 

= | [5(0.439299) + 8(0.247423) + 5(0.137889) = 0.540592. 

The exact values is I = 0.540420. 

The magnitudes of the errors in the one point, two point and three point rules are 
0.045575, 0.002956, and 0.000172 respectively. 

Example 3.24 Evaluate the integral I = f , using the Gauss three point formula. Compare 

Jo 1 + x 

with the exact solution. 

Solution We reduce the interval [0, 1] to [- 1, 1] to apply the Gauss three point rule. 
Writing x = at + b, we get 

0 = - a + b, 1 = a + b 

Solving, we get a = 1/2, b = 1/2. Therefore, x = (t + l)/2, dx = dt/2. 

The integral becomes 

mdt 

where f[t) = l/(t + 3). 

Using the three point Gauss rule, we obtain 

= | [5(0.449357) + 8(0.333333) + 5(0.264929)] = 0.693122. 

The exact solution is I = In (2) = 0.693147. 

The absolute error in the three point Gauss rule is 0.000025. 

J ' 2 (x 2 +2x+\) 

- -r- dx, by Gauss three point formula. 

o 1 + Oc + l ) 4 

(A.U. April I May 2005 ) 

Solution We reduce the interval [0, 2] to [- 1, 1] to apply the Gauss three point rule. 
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Writing x = at + b, we get 

0 = -a + b, 2 = a + b. 


Solving, we get a = 1, b = 1. Therefore, x = t + 1, and dx = dt. 
The integral becomes 



where 


fit) = {t + 2) 2 /[l + (t + 2) 4 ]. 


Using the three point Gauss rule, we obtain 



[5^-|) + 8A°, + 5/[|J 


| [5(0.461347) + 8(0.235194) + 5(0.127742)] = 0.536422. 


Remark 16 We have derived the Gauss-Legendre rules using the method of undetermined 
parameters. However, all the Gaussian rules can be obtained using the orthogonal polynomials. 
Consider the integration rule (3.73) 



We state the following theorem which gives these rules. 

Theorem 3.1 If the abscissas x k of the integration rule are selected as zeros of an orthogonal 
polynomial, orthogonal with respect to the weight function w(x) over [a, b], then the formula 
(3.99) has precision 2n + 1 (or the formula is exact for polynomials of degree <2n + 1). Further, 
\> 0 . 

The weights are given by 



where l k (x), k = 0, 1, ..., n are the Lagrange fundamental polynomials. 

For deriving the Gauss-Legendre formulas, we have w(x) = 1, [a, b ] = [- 1, 1], and the 
orthogonal polynomials are the Legendre polynomials P k (x). The weights are given by 



(3.100) 


Gauss-Legendre two point formula 

The abscissas x 0 , x 1 are the zeros of the Legendre polynomial P 2 (x). 
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Let x 0 = - 1/-J3, and = 1/^3 , we have 


Ux) = and fix) = 

Xq x 1 Xi — Xg 


The weights are given by 


\ = f i l 0 (x)dx = X X 1 = f^ 1 (x)dx = 1 


The two point rule is as given in (3.88). 

Gauss-Legendre three point formula 

The abscissas x 0 , x v x 2 are the zeros of the Legendre polynomial P 3 (x). 

Setting P 3 (x) = — (5x 3 - 3x) = 0, we obtain x = 0, ± —. 

2 V 5 

Let x 0 = - -J3/5, x-l = 0, and x 2 = ^3/5. We have 

(x — Xj)(x — X 2 ) ^ -«o)(* -^2) 

0 (x 0 -XiXXo -X 2 ) ’ (X! -Xo)(X! -x 2 )’ 

, r s _ (x-XplCx-Xx) 

2% (x 2 -x 0 )(x 2 -Xi) ’ 

The weights are given by 

= J^ZoCx) dx = k 1 = j^x) dx = ^,X 2 = f^l 2 ix)dx = |. 
The three point rule is as given in (3.97). 


< 


REVIEW QUESTIONS 


> 


1. Write the error term in the Gauss one point rule for evaluating the integral J fix)dx. 
Solution The error term in the Gauss one point rule is given by 


2. Write the error term in the Gauss two point rule for evaluating the integral J fix) dx. 
Solution The error term in the Gauss two point rule is given by 
1 - (4) - 1 < % < 1 . 










3. 

1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 
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Write the error term in the Gauss three point rule for evaluating the integral J fix )dx. 
Solution The error term in the Gauss three point rule is given by 


- ( EXERCISE 3.3 ) - 

Use three point Gauss formula to evaluate f —. 

Ji x 

Apply Gauss two point formula to evaluate [ ^ 2 . 

1+ x 

Using three point Gauss formula, evaluate f g . 


(At/. Nov. I Dec. 2003) 

(A. U. April / May 2005) 

(A.U. April/May 2004) 


Evaluate [ ^ + dx by Gauss three point formula. (At/. April/May 2005) 

J o 1 + (x + 1) 


Using the three point Gauss quadrature, evaluate f , .. (A.U. Nov. I Dec. 

Jo 


2005) 


j-1.5 _ 2 

Evaluate j 02 e % dx using the three point Gauss quadrature. (A. U. April/May 2003) 

r 2 dx 

Use two point and three point Gauss formula to evaluate I = J -—— . Compare with 
the exact solution. 

Use two point and three point Gauss formula to evaluate f ——-. 

Jo x 2 + 2x + 10 

Find the value of the integral / = f C ° S dx, using two point and three point Gauss 
h 1 + sin x 

formulas. 

In problem 7, write I = I I + I 2 = fix) dx + fix) dx. Then, evaluate each of the 
integrals by two point and three point Gauss formulas. Compare with the exact solution. 
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3.3.4 Evaluation of Double Integrals 

We consider the evaluation of the double integral 

1 (j f^X’ ^ dx j dy (3.101) 

over a rectangle x = a, x = b, y = c, y = d. (Fig. 3.2). 


(a, d) 


(a, c) 


(b, c) 


(b, c) 


Fig. 3.2. Region of integration 
(a rectangle). 


3.3.4.1 Evaluation of Double Integrals Using Trapezium Rule 

Evaluating the inner integral in (3.101) by trapezium rule, we obtain 


- J c [f(a,y) + f(b,y)\ dy. 


j b-a f rf r ^ 

Using the trapezium rule again to evaluate the integrals in (3.102), we obtain 
(b - a)(c - d) r 


1 = 


- [fia, c ) + fia, d) + fib, c) + fib, d)]. 


Notice that the points (a, c), ia, d), ib, c), ib, d) are 
the four corners of the rectangle (Fig. 3.2). If we denote 
h = b-a, k = d-c, we can write the formula as 


7 = 


hk 


I fia, c) + fia, d)+fib, c) + fib, d)]. (3.104) 


4 ’ ' Fig. 3.3. Weights in formula (3.104). 

The weights (coefficients of the ordinates f ) in the trapezium rule are given in the 
computational molecule (Fig. 3.3). 


Composite trapezium rule Divide the interval [a, b] into TV equal subintervals each of length 
h, and the interval [c, d\ into M equal subintervals each of length k. We have 

h = ,x 0 = a,x 1 = x 0 + h, x 2 = x 0 + 2 h, ..., x N = x 0 + N h = b, 

N u u JVU 

d — c 

k = ^^,y 0 = c,y 1 = y 0 + k,y 2 =y 0 + 2k, ...,y M = y 0 +Mk = d. 
The general grid point is given by ix e yj). Denote, fj = fix p y-). That is, 

foo = o> y 0 ) = A a > c )> Ao = K x v y<)’ •••> fm = y 0 ) = AA c ),..., 

A 1 = fix o> Ai = frx v yf ),..., f 0M = fix 0 , y M ) = fia, d), etc. 

If we use the composite trapezium rule in both the directions, we obtain 


I- 4 [Ao + 2( Ai + fm + ■•• + fm-d + fm 

+ 2 x' Ao + 2 Ai + 4 + ••• + fiM-J + fj (3.105) 

+ fm + 2( fm + fm + ••• + Aar-A + Aafl 
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If M = N = 1, we get the method given in (3.104). 

For M = N = 2, the weights in the formula are given in 
Fig. 3.4. 

For M = N = 4, the weights in the formula are given in 
Fig. 3.5. 



Remark 17 The order of the composite trapezium rule is Fig. 3.4. Weights in the trapezium 
1, that is, it integrates exactly polynomials of degree < 1, 

in x and y. If we use the same mesh lengths along x and y directions, that is, h = k, then 
Romberg extrapolation can also be used to improve the computed values of the integral. The 
Romberg formula is same as given in (3.60). 


2 


2 


2 2 2 


4 4 4 


4 4 4 


4 4 4 


2 


2 


2 2 2 1 


Fig. 3.5. Weights in the trapezium rule. 


Example 3.26 Evaluate the integral 


■rr 


dx dy 
x+y 


using the trapezium rule with h = k = 0.5 and h = k = 0.25. Improve the estimate using Romberg 
integration. The exact value of the integral is I = In (1024/729). Find the absolute errors in the 
solutions obtained by the trapezium rule and the Romberg value. 


Solution We have a = 1, b = 2, c = 1, d = 2. 
When h = k = 0.5, we have the nodes at (1, 1), 
(1.5, 1), (2, 1), (1, 1.5), (1.5, 1.5), (2, 1.5), (1, 2), 
(1.5, 2), (2, 2). The nodes are given in Fig. 3.6. 
The values of the integrand at the nodal points 
are obtained as the following. 


(1.5, 

1.5) 




(1.5,1) (2,1) 


Fig. 3.6. Nodal points, h = 0.5. Example 3.26. 
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(x,y) 

(l, l) 

(1.5, 1) 

(2, 1) 

(1, 1.5) 

(1.5, 1.5) 

f(x,y) 

0.5 

0.4 

0.333333 

0.4 

0.333333 

(x,y) 

(2, 1.5) 

(1, 2) 

(1.5, 2) 

(2, 2) 


f(x,y) 

0.285714 

0.333333 

0.285714 

0.25 



Using the trapezium rule, we obtain 


/ = — [{fll, 1) + ft 2, 1) + ft 1, 2) + ft 2, 2)} + 2{fll.5, 1) + /Cl, 1.5) + ft 2, 1.5) 

+ /11.5, 2)}+ 4 ftl.5, 1.5)1 
= 0.0625 [{0.5 + 0.333333 + 0.333333 + 0.25} 

+ 2{0.4 + 0.4 + 0.285714 + 0.285714} + 4(0.33333)] = 0.343303. 

With h = 0.25, we have the nodal points as shown in Fig. 3.7. 

The values at the nodal points are as the following. 

ftl, 1) = 0.5, ftl, 1.25) = ftl.25, 1) = 0.444444, 


/(l. 75, 1) = ftl, 1.75) = ftl.25, 1.5) = ftl.5, 1.25) = 0.363636, 

ft 2, 1) = ftl, 2) = /U.5, 1.5) = ftl.75, 1.25) = ftl.25, 1.75) = 0.333333, 
ft2, 1.25) = ftl.25, 2) = /C1.5, 1.75) = ft 1.75, 1.5) = 0.307692, 
ftl.75, 1.75) = ft 2,1.5) = ftl.5, 2) = 0.285714, 
ft2, 1.75) = ftl.75, 2) = 0.266667, ft 2, 2) = 0.25. 


(1.25,2) (1.5,2) (1.75,2) 


(1 -25, 

1.75) (1.5, 

1.75) (1.75, 

1.75) 

(1 -25, 

1.5) (1.5, 

1.5) (1.75, 

1.5) 

(1.25, 

1.25) (1.5, 

1.25) (1.75, 

1.25) 






(1.25,1) (1.5,1) (1.75,1) 


Fig. 3.7. Nodal points, h = 0.25. Example 3.26. 
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Using the composite trapezium rule, we obtain 
hk 

i= — [{/a, i)+ /12, i) + fa, 2) + f{2, 2)} + 2 {fa. 25 , u+ /u.s, d+ /u.75, u 
+ fa, 1.25)+ fa, 1.5) + fa, 1.75)+/12,1.25) + ^2, 1.5) + /12,1.75) 

+ /U.25, 2) + f{ 1.5, 2) + /( 1.75, 2)} + 4{/(1.25, 1.25) + /(1.25, 1.5) 

+ /(1.25, 1.75) + /{1.5, 1.25) + /(1.5, 1.5) + /(1.5, 1.75) + /(1.75, 1.25) 

+ /11.75, 1.5) + /(1.75, 1.75)}] 

= (0.015625)[{0.5 + 2(0.333333) + 0.25} + 2(2(0.444444) + 2(0.4) 

+ 2(0.363636) + 2(0.307692) + 2(0.285714) + 2(0.266667)} 

+ 4(0.4 + 2(0.363636) + 3(0.333333) + 2(0.307692) + 0.285714}] 

= 0.340668. 

Romberg integration gives the improved value of the integral as 

7 = | (47(0.25) - 7(0.5)] = | (4(0.340668) - 0.343303] = 0.339790. 

Exact value: 7 = In (1024/729) = 0.339798. 

The magnitudes of the errors in the solutions are the following. 

Trapezium rule with h = k = 0.5: | 0.339798 - 0.343303 | = 0.003505. 

Trapezium rule with h = k = 0.25: | 0.339798 - 0.340668 | = 0.000870 

Romberg value: | 0.339798 - 0.339790 | = 0.000008. 

Example 3.27 Evaluate I* f fix, y) dxdy by trapezium rule for the following data. 

Jo Jo 


y/x 

0 

0.5 

1.0 

1.5 

2.0 

0 

2 

3 

4 

5 

5 

1 

3 

4 

6 

9 

11 

2 

4 

6 

8 

11 

14 


(A.U. April I May 2005) 

Solution We have the step lengths along x-axis andy-axis as h = 0.5 and k = 1.0 respectively. 
Also, the number of intervals along x-axis and y-axis are M = 4 and N = 2. We have the 
following grid (Fig. 3.8). 
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(0,2) (0.5,2) (1,2) (1.5,2) 


(0.5, 

1) (1, 

1) (1.5, 

1) 






(0,0) (0.5,0) (1,0) (1.5,0) (2,0) 

Fig. 3.8. Nodal points, h = 0.5, k = 1.0. Example 3.27. 

Using the trapezium rule, we obtain 

I = [{/10, 0) + f{2, 0) + /(0, 2) + f{2, 2)} + 2{/(0.5, 0) + /(l, 0) 

+ /U.5, 0) + /(0, 1) + f{2, 1) + /(0.5, 2) + /(l, 2) + f{ 1.5, 2)} 

+ 4{/(0.5, 1) + /U, 1)+/(1.5, 1)}] 

= (0.125) [{2 + 5 + 4 + 14} + 2{3 + 4 + 5 + 3 + 11 + 6 + 8 + 11} 

+ 4{4 + 6 + 9}] 

= 0.125125 + 2(51) + 4(19)] = 25.375. 

3.3.4.2 Evaluation of Double Integrals by Simpson’s Rule 

We consider the evaluation of the double integral 

1 y)dx ] d y 

over a rectangle x = a, x = b, y = c, y = d. (Fig. 3.2). 

To apply the Simpson’s rule, let h = (b - a)/2 and k = (d - c)/2. 

Evaluating the inner integral by Simpson’s rule, we obtain 

/ = | I/la, y) + 4/(a + h,y)+ f{b, y)] dy (3.106) 

where a + h = (a + b)/2. 

Evaluating the integral again by Simpson’s rule, we obtain 

/ = y HM c) + 4 f(a, c + k)+ fia, d)} + 4 [f(a + h, c) + 4 f(a + h, c + k) 

+ f{a + h, d)} + [fib, c ) + 4 fib, c + k) + f(b, d)}] 
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= — [{fid, C) + fid, d) + fib, C) + fib, d)} + 4[fid, C + k) 


+ fid + h, c) + fid + h, d) + fib, c + k)} + 16 fid + h, c + k)\. (3.107) 


The weights (coefficients of the ordinates f ) 
in the Simpson’s rule are given in the computational 
molecule (Fig. 3.9) below. 

Composite Simpson’s rule 

Divide the interval [d, b] into 2 N equal parts each 
of length h = ib - a)/(.2N). 

Divide the interval [c, d\ into 2 M equal parts each 
of length h = id - c)/(2M). 


Jik 
9 x 



Fig. 3.9. Weights in Simpson’s 
rule (3.107). 


We have odd number of points on each mesh line and the total number of points, i2N + 1) 
(2Af + 1) is also odd. 


The general grid point is given by ix t , yj). Denote, f t - - fix f yj). 

For M = N = 2, the weights in the composite Simpson’s rule are given in Fig. 3.10. 


4 


hk, 

9 


2 


4 



4 


4 2 4 


Fig. 3.10. Weights in the Simpson’s rule. 


Example 3.28 Evaluate the integrdl 


I j-i.5 j *2 dx dy 

Jy = 1 j*= 1 x+y 

using the Simpson’s rule with h = 0.5 dlong x-uxis und k = 0.25 dlongy-uxis. The exuct vdlue of 
the integrdl is I = 0.184401. Find the dbsolute error in the solution obtdined by the Simpson’s 
rule. 
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Solution We have a = 1, b = 2, c = 1, d = 1.5. With h 
= 0.5, k = 0.25, we have the following nodal points as 
given in Fig. 3.11. 

The values at the nodal points are as follows. 

/ll, 1) = 0.5, f{l, 1.25) = 0.444444, 


(1,1.5) (1.5, 1.5) 


(1.5, 

1.25) 




(2,1.5) 
(2, 1.25) 


/U.5,D=/U,1.5) = 0.4, (hi) (1-5,1) (2,1) 

/Cl-5, 1.25) = 0.363636, Fig. 3.11. Nodal points. Example 3.28. 

fi 2, 1) =/U.5, 1.5) = 0.333333, 
f{2, 1.25) = 0.307692, fi 2, 1.5) = 0.285714. 

Simpson rule gives the value of the integral as 
hh 

I=™ [{/la, c) + /la, d) + ffb, c) + fib, d)} + 4{/la, c + k) 

+ /la + h, c) + /la + h,d) + fib, c + &)} + 16/la + h, c + k)\ 
= °^P [{/ll, 1) + /12, 1) + fa, 1.5) + /12, 1.5)} + 4{/ll.5, 1) + /ll, 1.25) 
+ /12, 1.25) + /11.5, 1.5)} + 16 /11.5, 1.25)] 

= [{0.5 + 0.333333 + 0.4 + 0.285714} + 4{0.4 + 0.444444 

+ 0.307692 + 0.333333} + 16(0.363636)] = 0.184432. 
The magnitude of the error in the solution is given by 

| 0.184401-0.184432 | = 0.000031. 


Example 3.29 Evaluate [ [ e x+y dx dy using Simpson and trapezium rules. 

Jo Jo 

(At/. May /June 2006 ; A.U. Nov. /Dec. 2006) 
(0.5,1) (1,1) 


Solution Since the step lengths are not prescribed, we 
use the minimum number of intervals required to use 
both the trapezium and Simpson’s rules. 

Let h = k = 0.5. We have the following grid of points 
(Fig. 3.12). 

At the nodal points, we have the following values 
of the integrand. 

/ 10 , 0 ) 


(0,1) 
(0, 0.5) 


(0.5, 

0.5) 




(0,0) (0.5,0) (1,0) 

Fig. 3.12. Nodal points. Example 3.29. 
= 1.0, /(0.5, 0) = /TO, 0.5) = e 0 - 5 = 1.648720, 


/ll, 0) = /TO, 1) = /T0.5, 0.5) = e 1 = 2.71828, 
fil, 0.5) =/(0.5, 1) = e 1 - 5 = 4.48169, fil, 1) = e 2 = 7.389056. 
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Using the trapezoidal rule, we obtain 
hk 

1= — [{/10, 0) +/u, 0) +/(0, 1) +/(1, 1)} + 21/10.5, 0) +/(0, 0.5) + /(1, 0.5) 
+ /10.5, 1)} + 4/(0.5, 0.5)] 

= 0.0625[{1.0 + 2(2.71828) + 7.389056} + 2(2(1.64872) 

+ 2(4.48169)} + 4(2.71828)] = 3.07627. 

Using the Simpson’s rule, we obtain 
hk 

i= 9 [{/co, o) + /a, o) + m i) + /a, dj + 4^0.5,0) + /(0,0.5) 

+ /(0.5, 1.0) +/(1.0, 0.5)} + 16/(0.5, 0.5)] 

0.25 

= — [{1.0 + 2(2.71828) + 7.389056} + 4(2(1.64872) 

+ 2(4.48169)} + 16(2.71828)] = 2.95448. 


The exact solution is 7 = e* e 3 ' = (e - 1 ) 2 = 2.95249. 


The magnitudes of errors in the solutions are 
Trapezium rule: | 3.07627 - 2.95249 | = 0.12378. 
Simpson’s rule: | 2.95448 - 2.95249 | = 0.00199. 


-f EXERCISE 3.4 


pi pi d"y 

1. Using Simpson’s 1/3 rule, evaluate -taking h = k = 0.5. 

Jo Jo 1 + x +y 

(A. U. April /May 2004) 

2. Evaluate f f ^ using trapezium rule, taking h = 0.5, k = 0.25. 

Jo Jo 1 + x +y 

(AM Nov. I Dec. 2006) 

3. Evaluate [ [ [ -, 77 -- 5 - dy dx by trapezium rule, taking h = k = 0.25. 

Jo l^Ji (l + x )(l + y ) J 


(A. U. Nov. /Dec. 2004 ; A. U. Nov. /Dec. 2005) 
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4. Evaluate [ [ ^ numerically with h = 0.2 along x-direction and k = 0.25 in the 

•h h x + y 

y- direction. 

p2.0 1*1.5 

5. Using trapezium rule, evaluate ln(x + 2 y)dydx choosing Ax = 0.15 and 

Ay = 0.25. (A. U. April/May 2003 ) 


6 . Using trapezium rule evaluate, 


j" J C ^ X ^ taking four sub-intervals. 


(A.U. Nov. /Dec. 2003 ) 


7. Evaluate the double integral f f — f X ^ 

(x * 1 2 * 4 5 6 7 +y 2 r‘ 


rule with two subintervals. 


sing the trapezium rule and Simpson’s 


8 . Evaluate the double ini 


tegral f f 
Jo Jo 


fix dy 


(3 + x)(4 + 

Simpson’s rule with two and four subintervals. 


using the trapezium rule and 


3.4 ANSWERS AND HINTS 


Exercise 3.1 

1. 1.0. 2.- 0.2225,52.170833. 

3. y is maximum at s = 2.3792 or x = 0.3792. y(maximum) = 0.0723. y is minimum at 

s = 1.1208 or x = - 0.8792. y(minimum) = - 0.2598. 

4. y is maximum at s = 1.0546 or x = 10.0546. y(maximum) = 1339.8637. y is minimum at 
s = - 2.0546. y( minim um) = 1300.1363. 

5. 3.9485,-3.5894. 

6 . - (h 2 / 6 ) f "'(x k ) + ..., or as - (h 2 /6) f'" (£), x k - h < ^ < x k + h. 

7. 3.3202, 3.3211. 8 . 0.2558. 

9. (dy/dQ) = sec 2 6 . For 9 = 31°, ( dy/dQ ) = 0.023967. sec (31°) = 0.1548. 

10. - 3. 11. 4.4235. Magnitude of error = 0.0582. 

12 . 135, 98. Since ( dy/dx ) is always positive, y is an increasing function. The maximum 
value is obtained at x = 9. Maximum value = 922. 

13. 135. 

14. h = 0.2: 7.3875. h = 0.1: 7.31. Exact: 7.2885. Magnitudes of errors are 0.099 and 0.0245 
respectively. Error is smaller for h = 0.1. 
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Exercise 3.2 

(For comparison, the exact solutions are given, wherever it is necessary). 

1. h = 0.125, 0.697024 2. h = 1, 35.65. 

3. h= n/ 6 , 1.954097, Exact: 2.0. 

4. h = 0.5, - 0.411059. Exact: cos 1 - cos 6 = - 0.4199. 

5. h = 2,360. 6.h = 0.25,1.565588. Exact: 2 tan” 1 1 = 570796. 

7. h = 0.25, 1.000169. Exact: 1. 

8 . h = 1:6.420728, h = 0.5: 6.391210. Romberg value = 6.389242. Exact: 6.389056. 

9. h = 3, I T = 1.840541, I s = 1.427027. Exact: tan ” 1 6 = 1.405648. 

10. Trapezium rule: (Romberg table). 

P =0 p =1 


h 

om 

om 

om 

h 

om 

om 

om 

1/2 

0.097110 



1/2 

0.072419 



1/4 

0.097504 

0.097635 


1/4 

0.061305 

0.057600 


1/8 

0.097604 

0.097637 

0.097637 

1/8 

0.054322 

0.051994 

0.051621 


Simpson’s rule: (Romberg table). 


P =0 p =1 


h 

om 

om 

om 

h 

om 

om 

om 

1/2 

0.097662 



1/2 

0.064740 



1/4 

0.097635 

0.097633 


1/4 

0.056448 

0.055895 


1/8 

0.097634 

0.097634 

0.097634 

1/8 

0.052283 

0.052005 

0.051944 


11. 1.76351, 1.79099. The second result is more accurate. 

12. h = 0.5, 0.402521, In (0.5) = 1.610084. Exact: 1.609438. 

13. h = Jt/10, I T = 1.983524, I s = 2.000110. Exact: 2. 

14. h = 1/6, 0.785396. 

Exercise 3.3 

(For comparison, the exact solutions are given, wherever it is necessary). 
1. 2x = t + 3, fit) = Hit + 3), 0.693122 2. 1.5. 

3. 2x = t + 1, fit) m 2/[4 + (t + l) 2 ], 0.785267 

4. x = t + l,f{t) = (t + 2) 2 /[l + (/ + 2) 4 ], 0.586423. 

5. 2x = t + l, fit) = 2/[16 + (t + l) 4 ], 0.216880. 
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6. x = 0.65 1 + 0.85, fit) = 0.65e _(0 ' 65t+0 ' 86)2 , 0.658602. 

7. x = t + l,fit)= 1/(4 1 + 7), /(Two point) = 0.320610, /(Three point) = 0.324390. 
Exact : 0.324821. 

8 . x = t + 1, fit) = l/[9 + it + 2)2], /(Two point) = 0.154639. /(Three point) = 0.154548. 

9. 2x = t + 5, fit) = cos it + 5)/[2(l + sin {(t + 5)/2}], /(Two point) = 0.407017. 

/(Three point) = 0.405428. 

10. I 1 :2x = t + 1, fit) = l/[2/{3 + 2 (t + 1)}], / : 2x = t + 3, fit) = l/[2{3 + 2 it + 3)}], 

Two point formula: I x = 0.211268, / 2 = 0.112971 ,1 = 0.324239. 

Three point formula: I x = 0.211799, / 2 = 0.112996 ,1 = 0.324795. Exact: 0.324821. 
Results are more accurate than in Problem 7. 

Exercise 3.4 

1. 9 points. 0.524074. 2. 15 points. 0.531953. 

3. 25 points. 0.312330. 4. 30 points. 0.232316. 

5. 15 points. 0.428875. 6 . 25 points. 0.340668. 

7. 9 points. I T = 0.142157, I s = 0.141900. 

8 . Two subintervals: I T = 0.064554, / g = 0.064199. 

Four subintervals: I T = 0.064285, I s = 0.064195. 
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Initial Value Problems For 
Ordinary Differential Equations 


4.1 INTRODUCTION 

The general form of an mth order ordinary differential equation is given by 

ct>(x, y, y', y", y im) ) = 0. (4.1) 

The order of a differential equation is the order of its highest order derivative and the 
degree is the degree of the highest order derivative after the equation has been rationalized 
in derivatives. A linear differential equation of order m can be written as 

a 0 (x)y (m) (x) + afxiy^Xx) + ... + o^CxJ/fr) + ajx)y(x) = r(x) (4.2) 

where a 0 (x), afx), a m (x) and r(x) are constants or continuous functions of x. 

The general solution of the equations (4.1) or (4.2) contains m arbitrary constants. The 
solution may be obtained in an implicit form as 

g(x, y, c v c 2 , ..., c m ) = 0, (4.3) 

or in an explicit form as 

y = h(x, c v c 2 , ..., C m ) (4.4) 

The m arbitrary constants c v c 2 , ..., c m can be determined by prescribing m conditions of 
the form 

y(x 0 ) = b 0 , y'(x 0 ) = b v y"(x 0 ) = b 2 , ..., (x 0 ) = b m _ v (4.5) 

The conditions are prescribed at one point x Q . This point x 0 is called the initial point and 
the conditions (4.5) are called initial conditions. The differential equation (4.1) or (4.2) to¬ 
gether with the initial conditions (4.5) is called an initial value problem. 

A first order initial value problem can be written as 

y’ = fix, y), y(x 0 ) = b 0 (4.6) 
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Reduction of second order equation to a first order system 

Let the second order initial value problem be given as 
a 0 (x) y"(x) + afx) y\x) + a 2 (x) y(x) = r(x), 

y(ac 0 ) = b 0 , y'(x 0 ) = b r (4.7) 

We can reduce this second order initial value problem to a system of two first order 
equations. 

Define u 1 = y. Then, we have the system 

u i =y' = u v = K 

uf = y" = [fix) - ai (x) y'(,x) - a 2 (x) y(x)] 

= a ^ [fix) - a^x) u 2 - a 2 {x) uj, u 2 (x 0 ) = b v 

The system is given by 

“ll = [“2 
“ 2 J 

where f 2 (x, u v u 2 ) = —^ . [r(x) - a 

a 0 (x) 

In general, we may have a system as 


»£:>]=[£] 


1 (x) u 2 - a 2 (x) 


Vi] J/iC*,*1^2)1 M x o)l = h 

^ 2 J L/2 (x >3'l-3'2)J’ b2(*o)J 

In vector notation, denote 

y = b'i,3' 2 ] T , f = \fi,f 2 ] T > b = 

Then, we can write the system as 

y' = fix, y), 

y(x 0 ) = b. (4.10) 

Therefore, the methods derived for the solution of the first order initial value problem 


L 6 iJ ‘ 
Kbjr 


^r = /foy)> ^ x o) = y 0 ( 4 - n ) 

can be used to solve the system of equations (4.9) or (4.10), that is, the second order initial 
value problem (4.7), by writing the method in vector form. 


Example 4.1 Reduce the following second order initial value problems into systems of first 
order equations: 

C i ) 2y"-5y'+6y = 3x, y(0) = 1, y'(0) = 2. 

Hi) x 2 y"+ (2x + 1 )y'+ 3 y = 6 , y(l) = 2, /(1) = 0.5. 
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Solution 

( i) Let u 1 = y. Then, we have the system 

uf = u 2 u^O) = 1, 

u 2 ' = ^[3x + 5 y' - 6 y] = i [3x + 5 u 2 - 6 uf), u 2 (0) = 2. 

The system may be written as 

\U 2 \ ’ L“2(°)J L 2 J 

where ffx, u v u 2 ) = u 2 and f 2 (x, u v u 2 ) = [3x + 5 u 2 - 6UJ/2. 

(ii) Let u 1 = y. Then, we have the system 

w 1 ' = u 2 , uj, 1) = 2, 

u ' a 4" [6 - ( 2 * + 1 )/ - 3y] = 4 - [6 - ( 2x + 1 )m 2 - SaJ, a 2 (l) = 0.5. 

x x 

The system may be written as 


M Jf 1 ix,u 1 ,u 2 )l k(l)l = [2 1 
\u 2 \ \f2^x,u 1 ,u 2 )\ ’ — L°- 5 J 

where f x {x, u v u 2 ) = u 2 and f 2 (x, u v u 2 ) = [6 - (2x + 1 )u 2 - 3uj/x 2 . 

We assume the existence and uniqueness of solutions of the problems that we are considering. 
Numerical methods We divide the interval [x 0 , b] on which the solution is desired, into a 
finite number of subintervals by the points 

x 0 <x 1 <x 2 < ... <x n = b. 

The points are called mesh points or grid points. The spacing between the points is 
given by 

h i = x i -x i V i = 1,2, ..., n. (4.12) 

If the spacing is uniform, then h t = h = constant, i = 1, 2, ..., n. 

For our discussions, we shall consider the case of uniform mesh only. 


4.2 SINGLE STEP AND MULTI STEP METHODS 

The methods for the solution of the initial value problem 

y' = fix, y), ybcj = y 0 (4.13) 

can be classified mainly into two types. They are ii) single step methods, and Hi) multi step 
methods. 
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We denote the numerical solution and the exact solution at x- by y l and y(x t ) respectively. 

Single step methods In single step methods, the solution at any point x i+1 is obtained using 
the solution at only the previous point x v Thus, a general single step method can be written as 
y i+ 1 =y t + h <K* i+1 , x t , y i+v yh ) (4.14) 

where <|> is a function of the arguments x (+1 , x t , y i+v y t , h and depends on the right hand side 
fix, y) of the given differential equation. This function <|> is called the increment function. 

Ify- + i can be obtained simply by evaluating the right hand side of (4.14), then the method 
is called an explicit method. In this case, the method is of the form 

y i+ 1 = y t + h <|)(x., y e h ). (4.15) 

That is, we compute successively 

y 1 = y 0 + h <Kx 0 , y 0 , h), y 2 =y 1 + h <]>(%, y v h) . 

If the right hand side of (4.14) depends on y i+1 also, then it is called an implicit method, 
that is, we obtain a nonlinear algebraic equation for the solution of y i+l (if the differential 
equation is nonlinear). 

Local truncation error or discretization error The exact solutiony(x i ) satisfies the equation 

y(x i+1 ) = yixf) + h 4>(*. +1 , x t , yix i+1 ), yixf), h) + T i+1 (4.16) 

where T i+1 is called the local truncation error or discretization error. Therefore, the Trunca¬ 
tion error (T.E.) is defined by 

T i+ 1 = y(x i+1 ) - yixf) - h <|>(x i+1 , x p y(x i+1 ), yixf), h). (4.17) 

Order of a method The order of a method is the largest integer p for which 

^T i+1 = Oih p ). (4.18) 

h 

Multi step methods In multi step methods, the solution at any point x - +1 is obtained using 
the solution at a number of previous points. Suppose that we usey(x) and yix) at k + 1 previous 
points x - +1 , Xp x i V ..., x i k+1 . That is, the values 

v •••> y^ + 1 - y'i + v y /> /«*•••* y'i- k+ 1 

are used to determine the approximation to yix) at x i+r We assume that the numerical solu¬ 
tion is being obtained at x i+1 and the solution values at all the required previous points are 
known. We call the method as a k-step multi step method. 

For example, a two step method uses the values y i+ 1 ,y i , y i V y' i+1 , y', y’ i X and the method 
can be written as 


or as 


y i+ 1 = y t + h <|>(* i+1 , x t , x i V y i+v y t , y t _ v h) 
y i+ i = y ■_ 1 + h <Kx i+1 , x., x i V y i+1 ,y ■, y i V h), 
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where <|> depends on the right hand side fix, y) of the given differential equation. This function 
<j) is called the increment function. 

If y i+1 can be obtained simply by evaluating the right hand side, then the method is 
called an explicit method. In this case, the two step method is of the form 


y ux =y t + hd/ix^ x i V h) 

y i+1 = 3Vi + h ¥*i, x t _ v y p yi_ v h). 


or as 


If the right hand side depends on y i+1 also, then it is called an implicit method, that is, 
we obtain a nonlinear algebraic equation for the solution of y i+l (if the differential equation is 
nonlinear). 

A general ft-step explicit method can be written as 

y i+ 1 =3' i + H^_ k+ 1 ,..., *i_i, *i, y t _ k+ 1 ,y M , y t , h) 

and a general ft-step implicit method can be written as 

y i+ 1 = Vi + h ^ x i- k+ v •••> x i> x i+ 1> yi- k+ v ■■■> y» Jw . h) - 

We now derive a few numerical methods. 

4.3 TAYLOR SERIES METHOD 

Taylor series method is the fundamental numerical method for the solution of the initial value 
problem given in (4.13). 

Expanding yix) in Taylor series about any point Xj , with the Lagrange form of remain¬ 
der, we obtain 



+- 1 — (x - Xi ) p+1 y (p+1) (x; + 0ft) 

(p +1 )! 


(4.19) 


where 0 < 0 < 1, x e [x 0 , b ] and b is the point up to which the solution is required. 

We denote the numerical solution and the exact solution at x- by y t and yixf) respec¬ 
tively. 

Now, consider the interval [x ; , x i+1 ]. The length of the interval is ft = x- +1 - x-. 

Substituting x = x i+1 in (4.19), we obtain 
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Neglecting the error term, we obtain the Taylor series method as 


, , h 2 „ h p (p) 

y i+ i=yi + h yi + y t +-+JJVi ■ 


(4.20) 


Note that Taylor series method is an explicit single step method. 

Using the definition given in (4.17), the truncation error of the method is given by 

T i + 1 = , h \.. y (p+1) (Xi + Oh). (4.21) 

i+1 (p + 1)! 

Using the definition of the order given in (4.18), we say that the Taylor series method 
(4.20) is of order p. 

For p = 1, we obtain the first order Taylor series method as 

37+1 = 37 + hy{ =y t + hfix^ y f ). (4.22) 

This method is also called the Euler method. The truncation error of the Euler’s method is 


T.E. = y'( (x t + Oh). (4.23) 

Sometimes, we write this truncation error as 
A 2 h 3 

T.E. = 2 , 3'"(*;)+ 3! y’”(x i ) + ... (4.24) 


Since, |(T.E.) = 0(h), 

h 

Euler method is a first order method. If the higher order derivatives can be computed, then 
(4.24) can be used to predict the error in the method at any point. 


Remark 1 Taylor series method cannot be applied to all problems as we need the higher order 
derivatives. The higher order derivatives are obtained as 


/ = Ax, y), y" = 


ox dy dx 


y „, = 

dx v ch dy dx J dy v/bc dy dx J dx 


= 4 + 2/4 + p 4 + f y (f x + ff y ), etc. 

The number of partial derivatives required, increases as the order of the derivative ofy 
increases. Therefore, we find that computation of higher order derivatives is very difficult. 
Hence, we need suitable methods which do not require the computation of higher order 
derivatives. 




186 


NUMERICAL METHODS 


Remark 2 The bound on the truncation error of the Taylor series method of order p is given 
by 

1 T "‘ 1 = | (pTTjT + ew | £ (^TljT Mp " (4 - 25 > 

where M p+ i= max ly (p+1) (*) |. 

The bound on the truncation error of the Euler method (p = 1) is given by 

| T.E. | < ^ ^maxJy"Gc)f. (4.26) 

Remark 3 For performing the error analysis of the numerical methods, we need the Taylor 
series expansion of function of two variables. The Taylor expansion is given by 


= fix, y) + (hf x + k f y ) + ^ ( h 2 f xx + 2 hk f xy + k 2 f yy ) + ... (4.27) 

Remark 4 Extrapolation procedure (as described in numerical integration for Romberg inte¬ 
gration) can also be used for the solution of the ordinary differential equations. We illustrate 
this procedure for Euler’s method. Denote the numerical values obtained with step length h 
by y E ih). Euler’s method is of first order, that is, the error expression is given by 

y{x) - y E (h ) = c-Ji + cji 2 + c 3 h 3 + ... (4.28) 

Repeating the computations with step length qh, 0 < q < 1, we get the error of approxi¬ 
mation as 

y{x) - y E {qh) = c-^qh) + c 2 (qh) 2 + c 3 (qh) 3 + ... (4.29) 

Eliminating c v we obtain 

q\y(x) -y E (h)\ - \y(x)-y E (qh)\ = c 2 (q - q 2 )h 2 + ... 
or (q - l)y(x) - [q y E (x) - y E (qh )] = c 2 (q - q 2 )h 2 + ... 

Neglecting the 0(h 2 ) term, we get the new approximation to y(x) as 

(4.30) 

q -1 

For q = 1/2, we get 

_ l(V2)y E (h)-y E m)] 

(1/2)-1 


[2y E (M2)-y E m 


[2y E (h/2)-y E m. 


(4.31) 


2-1 
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We can derive general formula for extrapolation. Let the step lengths be successively 
reduced by the factor 2. That is, we use the step lengths, h, hi 2, (h/2 2 ) .The formula is given 

by 




For m = 1, we get the first column of approximations as 

y(x) « 2y * VM-y$\h) = 2y (0) m) _ y m (h) 

For m = 2, we get the second column of approximations as 


y(*)« 


2 2 y ( )P(h/2)-y ( i\h) 


(4.32) 


(4.33) 


(4.34) 


Example 4.2 Solve the initial value problem yy' = x, y(0) = 1, using the Euler method in 0 <x 
< 0.8, with h = 0.2 and h = 0.1. Compare the results with the exact solution atx = 0.8. Extrapo¬ 
late the result. 


Solution We have 
Euler method gives 
Initial condition gives 


y' = fix, y) = ixly). 

y i+1 =yi + hfix i , y t ) =y t 

x o = 0 >yo = 1 - 
0.2 Xi 

y i+ i=yi + — ■ 


When h = 0.2, we get 
We have the following results. 


hx t 
Vi ' 


y(x 1 )=y( 0.2) ~y x =y 0 + = 1.0. 

yo 


y(* 2 ) = y(0.4) « y 2 = y x + = 10 + = 1.04. 

3h 10 

y(* 3 ) =y(0.6) =y 3 =y 2 + ^^ = 104 + ^?^ = 1.11692 
y(x 4 ) = y(0.8) * y 4 = y 3 + = 111692 + ^||| = 1.22436. 


When h = 0.1, we get y i+1 =y t + . 

Vi 


We have the following results. 
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0.1*o 


U.lx 

y(*i) = y (0. l) = y i = y o + — 

yo 

y(* 2 )=y(0.2)«y 2 = y 1 + 10 + ° 1( ^ 1) = 1.01. 

yi io 


y(x 3 ) = y(0.3) = y 3 = y 2 + = 101 + 

y(x 4 ) = y(0.4) - y 4 = y 3 + = 10298 + = 1.05893. 

y(*(s) = y(0.B) ~y 5 =y*+^ L = 105893 += 1.09670. 

yfee) = y(0.6) = 3^6 = y 5 + — = 10967 + = 1-14229. 

y 5 109b/ 

,(*,) = M0.7) ■ yi =y, * = L14229 + |^g| = 1,19482. 

,fa s ) = ,(0.8) 119482 + = 1.25341. 


0 . 1 ( 0 . 2 ) 


: 1.02980. 


The exact solution is y = -Jx 2 +1 ■ 

At x = 0.8, the exact value is 31(0.8) = ^1.64 = 1.28062. 

The magnitudes of the errors in the solutions are the following: 

h = 0.2: | 1.28062 - 1.22436 | = 0.05626. 
h = 0.1: | 1.28062 - 1.25341 | = 0.02721. 

Using (4.31), we get the extrapolated result as 

y(0.8) = [2y E (h/2) -y E m = 2(1.25341) - 1.22436 = 1.28246. 

The magnitude of the error in the extrapolated result is given by 
| 1.28062 - 1.28246 | = 0.00184. 

Example 4.3 Consider the initial value problem y' = x(y + 1), y(0) = 1. Compute 31(0.2) with h 
= 0.1 using (i) Euler method (ii) Taylor series method of order two, and (iii) fourth order Taylor 

series method. If the exact solution is y = -1 + 2e* /2 , find the magnitudes of the actual errors 
for 31(0.2). In the solutions obtained by the Euler method, find the estimate of the errors. 


Solution We have fix, y) = x(y + 1), x 0 = 0, y 0 = 1. 

( i ) Euler’s method: y i+1 = y t + h fix jt yf = y t + 0.1 [x t (y t + 1)]. 

With x 0 = 0, 3^ = 1, we get 
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3/(0.1) ~y 1 = y 0 + 0.1[x 0 (y 0 + 1)] = 1 + 0.1[0] = 1.0. 
With x x = 0.1, y x = 1.0, we get 

y(0.2) ~y 2 = yi + 0.1 [* 1 (y 1 + 1)] 

= 1.0 + 0.1[(0.1)(2)] = 1.02. 

(is) Taylor series second order method. 


y i+ 1 = y t + h y' + y" = y t + 0.1 yf + 0.005y 
y" = xy' + y + 1. 


We have 


With x 0 = 0, y 0 = 1, we get 

Vo = y 0 " = x $d + 3 / 0 +1 = 0 +1 + 1= 2. 

y(0.1) = y-i = y 0 + O.lyo + 0.005yo 
= 1 + 0 + 0.005 [ 2] = 1.01. 

With x x = 0.1, y 1 = 1.01, we get 

y{ = 0.1(1.01 + 1) = 0.201. 

y" = x x y{ + y 1 + l = (0.1X0.201) + 1.01 + 1 = 2.0301. 
y(0.2) = y 2 = y ± + 0.1 y/ + 0.005^/ 

= 1.01 + 0.1 (0.201) + 0.005(2.0301)] = 1.04025. 
(Hi) Taylor series method of fourth order. 



0.0001 (4) 

+-y, 

24 ' 


= y t + 0.1 y' + 0.005 y" + — y"‘ 


We have y" = xy' +y + 1, y'" = xy" + 2 y', y (4) = xy'" + 3 y". 

With x 0 = 0, y 0 = 1, we get 

y 0 ' = °> V = 2 - y~ = x oVo" + W = °> y 0 w = + ^o" = 0 + 3 < 2 ) = 6 - 

y(0.1) =y 1 = y Q + 0.1y 0 ' + 0.005y 0 " 

0.0001 

= 1 + 0 + 0.005 (2) + 0 + —— (6) = 1.010025. 

24 

With x 1 = 0.1, y 1 = 1.010025, we get 


y* = 0.1(1.010025 + 1) = 0.201003. 

y" = x x y" +y 1 + 1 = (0.1X0.201003) + 1.010025 + 1 = 2.030125. 
y{" = x x y" + 2 \y{ = 0.1(2.030125) + 2(0.201003) = 0.605019, 
yi (4) = x x y” + 3 y" = 0.1(0.605019) + 3(2.030125) = 6.150877. 



190 


NUMERICAL METHODS 


y(0.2) = y 2 = 1.010025 + 0.1(0.201003) + 0.005(2.030125) + (0.605019) 

+ Q ^ 01 (6.150877) = 1.040402. 

24 

The exact value is y(0.1) = 1.010025, y(0.2) = 1.040403. 

The magnitudes of the actual errors at x = 0.2 are 

Euler method: | 1.02 - 1.040403 | = 0.020403. 

Taylor series method of second order: | 1.04025 - 1.040403 | = 0.000152. 

Taylor series method of fourth order: | 1.040402 - 1.040403 | = 0.000001. 

To estimate the errors in the Euler method, we use the approximation 

T.E. = ^/'(*;). 

We have y 0 ' = 0, y 0 " = 2. 

0.01 

[Estimate of error iny(O.l) at* = 0.1] = —— (2) = 0.01. 

y{ e x x (y 1 + 1) = 0.2, 

y" = 1 + y± + x${ = 1 + 1 + 0.1(0.2) = 2.02. 

[Estimate of error in y(0.2) at x = 0.2] = (2.02) = 0.0101. 

Remark 4 In Example 4.3 (iii), notice that the contributions of the fourth and fifth terms on 
the right hand side are 0.000101 and 0.000026 respectively. This implies that if the result is 
required to be accurate for three decimal places only (the error is < 0.0005), then we may 
include the fourth term and the fifth term can be neglected. 

Example 4.4 Find y at x = 0.1 and x = 0.2 correct to three decimal places, given 

y'-2y = 3e x , y( 0) = 0. (A. U. Nov. /Dec. 2006) 

Solution The Taylor series method is given by 

, , h 2 „ h 3 h A (4) 
yi + i=yi+hyi+—y i + —y i + — y\’+... 

We have y' = 2y + 3e x , y" = 2y' + 3e x , y'" = 2y" + 3e x , y (4) = 2 y'" + 3e x . 

With x 0 = 0, y Q = 0, we get 

y 0 ' = 2y 0 + 3e° = 3, y" = 2y 0 ' + 3 = 2(3) + 3 = 9, 

y'" = 2y" + 3 = 2(9) + 3 = 21, y = 2y'" + 3 = 2(21) + 3 = 45. 
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The contribution of the fifth term on the right hand side of the Taylor series is 
h 4 (4) 0.0001 

J[ y ° = —24T (45) = °- 000187 < 0 - 0005 . 

Therefore, it is sufficient to consider the five terms on the right hand side of the Taylor 
series. We obtain 


0.001 0.0001 (4) 

y(0.1) ~y 1 = y 0 + 0.1 y 0 + 0.005y 0 + —— + 24 

= 0 + 0.1(3) + 0.005(9) + (21) + °^ 01 (45) 

= 0.3 + 0.045 + 0.0035 + 0.000187 = 0.348687. 

With x 1 = 0.1, y x = 0.348687, we get 

= 2y x + 3e 01 = 2(0.348687) + 3(1.105171) = 4.012887, 
y{ = 2y{ + 3e 01 = 2(4.012887) + 3(1.105171) = 11.341287, 
y"' = 2 y" + 3e01 = 2(11.341287) + 3(1.105171) = 25.998087, 

y[ 4) =2 yi '" + 3e 01 = 2(25.998087) + 3(1.105171) = 55.311687. 


The contribution of the fifth term on the right hand side of the Taylor series is 

h 4 ( 4 ) 0.0001 

IT-™ =_ 24~ (55 - 311687) = 0.00023 < 0.0005. 

Therefore, it is sufficient to consider the five terms on the right hand side of the Taylor 
series. We obtain 


y(0.2) » y 2 = y x + 0.1 y{ + 0.005 y” + y/" + °'^ 01 y} 4) 

= 0.348687 + 0.1(4.012887) + 0.005 (11.341287) 

0001 998087) + (55.311687) 

6 24 

= 0.348687 + 0.401289 + 0.056706 + 0.004333 + 0.00023 


= 0.811245. 

It is interesting to check whether we have obtained the three decimal place accuracy in 
the solutions. 

The exact solution is y(x) = 3{e^ - e*), and y(0.1) = 0.348695, y(0.2) = 0.811266. 

The magnitudes of the errors are given by 

| y(0.1) —y-y | = | 0.348695-0.348687 | = 0.000008. 

| y(0.2) -y 2 | = | 0.811266-0.811245 | = 0.000021. 
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Example 4.5 Find the first two non-zero terms in the Taylor series method for the solution of 
the initial value problem 

y' = x 2 +y 2 , y{ 0) = 0. 

Solution We have fix, y) = x 2 + y 2 . We have 

;y(0) = 0, y\ 0) = 0 + b(0)] 2 = 0, 
y" = 2x + 2yy', j/"(0) = 0 + 2y(0y(0) = 0, 

3 /'" = 2 + 2| yy"+ (y') 2 ], y"X 0) = 2 + 2 \y( 0) y'X 0) + y(O)} 2 ] = 2, 
y (4) = 213 / 3 -'" + 3y'y"\, y^( 0) = 2[y(0y"(0) + 3 3 / / (0)y"(0)] = 0, 

/ 5) = 2 [yy t4) + 4 y'y'" + 3(y") 2 ], 

3' (5) (0) = 2b/(0)y (4) (0) + 4yX0)y"X0) + 3ty"(0)} 2 ] = 0, 
y m = 2 b' 3 ' t5) + 5 y'y (4) + 10 y"y'"J, 
y (6) ( 0) = 2ly(0)y (5> (0) + 5yX0}y (4) (0) + 10y"(0)y"X0)l = 0, 
y m = 2lyy <6> + 6y'y <s > + 153/ , y (4 > + 10 (y'") 2 ], 

3 / t 7 ) ( 0 ) = 2b/(0) 3 /®( 0 ) + 63 /'( 0 )y ( 5 ) ( 0 ) + 15y"(0)y IA) (0) + 10y"(0)} 2 ] = 80. 
The Taylor series with first two non-zero terms is given by 



We have noted earlier that from application point of view, the Taylor series method has 
the disadvantage that it requires expressions and evaluation of partial derivatives of higher 
orders. Since the derivation of higher order derivatives is difficult, we require methods which 
do not require the derivation of higher order derivatives. Euler method, which is an explicit 
method, can always be used. However, it is a first order method and the step length h has to be 
chosen small in order that the method gives accurate results and is numerically stable (we 
shall discuss this concept in a later section). 

We now derive methods which are of order higher than the Euler method. 

4.3.1 Modified Euler and Heun’s Methods 

First, we discuss an approach which can be used to derive many methods and is the basis for 
Runge-Kutta methods, which we shall derive in the next section. However, all these methods 
must compare with the Taylor series method when they are expanded about the point x = x t . 
Integrating the differential equation y' = fix, y) in the interval [x., x. +1 ], we get 


J 1 ^dx = j 1+1 f(x,y)dx 


or 



(4.35) 
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Applying the mean value theorem of integral calculus to the right hand side, we obtain 
y(x i+ 1 ) -y(x t ) = (x i+1 - x t ) f ix i + 0 h, y(x t + 6 h)), 

or y{x i+ 1 ) = y(x.) + h f{x t + Q h, y{x i + 9 h)), 0 < 0 < 1. (4.36) 

Since x i+1 -x i = h. Any value of 0 e [0, 1] produces a numerical method. 

We note that y' and hence f(x, y) is the slope of the solution curve. In (4.35), the integrand 
on the right hand side is the slope of the solution curve which changes continuously in [x ; , x ;+1 ]. 
If we approximate the continuously varying slope in [x t , x i+1 \ by a fixed slope or by a linear 
combination of slopes at several points in [x t , x i+1 ], we obtain different methods. 

Case 1 Let 0 = 0. In this case, we are approximating the continuously varying slope in [x p x ;+1 ] 
by the fixed slope at x t . We obtain the method 
y i+ 1 = y t + hf[x t , y.), 

which is the Euler method. The method is of first order. 


Case 2 Let 0 = 1. In this case, we are approximating the continuously varying slope in [x p x i+1 \ 
by the fixed slope at x i+v We obtain the method 

y i+1 =y t + hf(x i+1 ,y i+1 ), (4.37) 

which is an implicit method as the nonlinear term fhc i+1 , y i+ f occurs on the right hand side. 
This method is called backward Euler method. The method is of first order. 

The method can be made explicit by writing the approximation y. +1 - y t + hf{x t , y.) on 
the right hand side of (4.37). Then, we have the explicit method 

y i+ l=yi+ hf\x M , y t + hfix ft). (4.38) 


Case 3 Let 0 = 1/2. In this case, we are approximating the continuously varying slope in 
[x t , x i+1 ] by the fixed slope at x i+1/2 . We obtain the method 


yi +1 =y i + h f\x i+ ^,y(x i+ ^] 


However, x t + {hi 2) is not a nodal point. If we approximate y(x t + (A/2)) on the right hand 
side by Euler method with spacing A/2, that is, 

y + =y i + f f^i>y^ 

we get the method 

y i+ 1 = y t + hf + |, y t + | f{x u y<)\ (4.39) 

The method is called a modified Euler method or mid-point method. The slope at the 
mid-point is replaced by an approximation to this slope. 
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Error of approximation 

The truncation error in the method is given by 

T.E. =y(x i+1 )-y(x i )-hf\x i + ^,y(x i ) + ^f(x i ,y i )j 

, , h 2 „ 
y + h y + — y + ... 

where all the terms are evaluated at (x t , y.). Using the expressions for y' and y", we obtain 
T.E. = |^y + hf + {f x + f fy) + (five terms of h 3 ) + ...j - y 

- h | 'f + ^f x + ^ffy+ (three terms of h 2 ) + ... j 
= (terms of h 3 ) + ... 

The truncation error is of order 0(h 3 ). Therefore, the method is of second order. 

Case 4 Let the continuously varying slope in [x p x. +1 ] be approximated by the mean of slopes 
at the points x- and x i+v Then, we obtain the method 

y i+ 1 = y i + ^ I y .) + f{x i+1 , y i+1 )] 

= ^+ 2 Vi+fiJ (4.40) 

where fix u y.) = f t and fix i+v y i+1 ) =f i + r The method is an implicit method. It is also called the 
trapezium method. The method can be made explicit by writing the approximation 

y i+ 1 = y t + hfixyf) =y i + hf i 

on the right hand side of (4.32). Then, we have the explicit method 

y i+ 1 = y j + ~ I fix t , yf) + fix i+1 , y t + h ff}\. (4.41) 

The slope at the point x i+1 is replaced by an approximation to this slope. The method is 
called Heun’s method or Euler-Cauchy method. 

Error of approximation 

The truncation error in the method is given by 

T.E. = y(x i+1 ) - yixf) - ^ I fixf) + f[x i +h,y i + h fix))] 

y + hy' + y" + ...j - y - ^ [2 f + h f x + hf f y + (three terms of h 2 ) +...] 
where all the terms are evaluated at (x t , y ■). Using the expressions for y' and y", we obtain 


~ y ~ h\f + ^ f x + ^ f f y + (three terms of h 2 ) +.. 
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T.E. = |^y + hf + (f x + f f y ) + (five terms of h 3 ) +... 

- ^ [2 f+hf x + hff y + (three terms of h 2 ) + ...] 

= (terms of h 3 ) + ... 

The truncation error is of order 0(h 3 ). Therefore, the method is of second order. 

Example 4.6 Solve the following initial value problem using the modified Euler method and 
Heun’s method with h = 0.1 for x e [0, 0.3]. 

y' = y + x, 3 /( 0 ) = 1 . 

Compare with the exact solution y(x) = 2e x - x - 1. 

Solution 

( i ) Modified Euler method is given by 

y i+ i =y« + h f(*i +1. Vi +1 

= y. + 0.1 f[ Xi + 0.05, y. + 0.05 /(x p y £ ». 

We have x 0 = 0, y 0 = 1.0, y 0 ' = f 0 = y Q + x 0 = 1.0 

y(0.1) - yi = y 0 + 0.1 f{x 0 + 0.05, y 0 + 0.05 f 0 ) 

= 1.0 + 0.1 /(0.05, 1.05) = 1.0 + 0.1 (1.1) = 1.11. 

*! = 0.1, 3 h = 1.11, yf=f 1 =y 1 +x 1 = 1.U + 0.1 = 1.21. 
y(0.2) « y 2 = y 1 + 0.1 + 0.05, y x + 0.05 ff) 

= 1.11 + 0.1 /(0.15, 1.11 + 0.05(1.21)) 

= 1.11 + 0.1 /(0.15, 1.1705) = 1.24205. 
x 2 = 0.2, y 2 = 1.24205, yf =f 2 = y 2 + x 2 = 1.24205 + 0.2 = 1.44205. 

340.3) » y 3 = y 2 + 0.1 f(x 2 + 0.05, y 2 + 0.05 f 2 ) 

= 1.24205 + 0.1 f{ 0.25, 1.24205 + 0.05(1.44205)) 

= 1.24205 + 0.1 /(0.25, 1.31415) = 1.39846. 

The errors in the solution are given in Table 4.1. 


Table 4.1. Errors in the modified Euler method. Example 4.6. 


Point 

Numerical solution 

Exact solution 

Magnitude of error 

0.1 

1.11 

1.11034 

0.00034 

0.2 

1.24205 

1.24281 

0.00076 

0.3 

1.39846 

1.39972 

0.00126 
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( ii ) The Heun’s method is given by 

y i+ 1 “ y t + \ \fep y) + ft x i+ v yi + h 

= y t + 0.05 | fat, yf) + f{x i+1 , y t + 0.1 /))] 

Denote y* = y t + 0.1 // Then, we write the method as 
y i+ 1 = y t + 0.05 Ifix^ y .) + fix i+v y-*)] 

We have x 0 = 0,y 0 = l.Oj 0 '=f 0 =y o + i 0 = 1.0, y 0 * =y 0 + 0.1 f 0 = 1 + 0.1 (1) = 1.1. 
y(0.1) =y 1 = y Q + 0.05 \f 0 + fix v y 0 *)] 

= 1.0 + 0.05[1.0 + 1.2] = 1.11. 
x 1 = 0.1, y 1 = 1.11, y{ = fi =y x + x 1 = 1.11 + 0.1 = 1.21. 
yf =y 1 + 0.1 f x = 1.11 + 0.1 (1.21) = 1.231. 
y(0.2) =y 2 = y x + 0.05^ + f{x 2 , y *I 

= 1.11 + 0.05[1.21 +/(0.2, 1.231)] 

= 1.11 + 0.05 [1.21 + 1.431] = 1.24205. 
x 2 = 0.2, y 2 = 1.24205, y 2 ' =f 2 = fi. 0.2, 1.24205) = 1.44205. 
y 2 * =y 2 + 0.1 f 2 = 1.24205 + 0.1 (1.44205) = 1.38626. 
y(0.3) = y 3 = y 2 + 0.05 [ f 2 + fix 3 , y 2 *)] 

= 1.24205 + 0.051/2 + f{ 0.3, 1.38626)] 

= 1.24205 + 0.05[1.44205 + 1.68626] = 1.39847. 

The errors in the solution are given in Table 4.2. Note that the modified Euler method 
and the Heun’s method have produced the same results in this problem. 


Table 4.2. Errors in modified Euler method. Example 4.6. 


Point 

Numerical solution 

Exact solution 

Magnitude of error 

0.1 

1.11 

1.11034 

0.00034 

0.2 

1.24205 

1.24281 

0.00076 

0.3 

1.39847 

1.39972 

0.00125 


Example 4.7 For the following initial value problem, obtain approximations to y(0.2) and 
y(0.4), using the modified Euler method and the Heun’s method with h = 0.2. 
y'=- 2xy 2 , y(0) = 1. 

Compare the numerical solutions with the exact solution y(x) = 1/(1 + x 2 ). 


Solution 

( i ) Modified Euler method is given by 
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y i+ 1 = y i + hf[x l + } ^,y l + } ^ f(x h 
= y t + 0.2 fix t + 0.1, y. + 0.1 /(*., y t )). 

We have x 0 = 0, y 0 = 1, fix, y) = -2 xy 2 . Denote y.* = y t + 0.1 flx t , yf). 

y 0 ' = f 'o = °.yo* = yo + 0 - 1 /o = L 

y(0.2) «y x = y 0 + 0.2 /(0.1, 1) = 1 + 0.2 (-0.2) = 1 - 0.04 = 0.96. 
x x = 0.2, y x = 0.96, y{ = f x = -2x^ 2 = -2(0.2)(0.96) 2 = -0.36864, 
y x * =y x + 0.1 f x = 0.96 + 0.1C-0.36864) = 0.92314. 
y(0.4) = y 2 = y x + 0.2 flx x + 0.1, yf) = 0.96 + 0.2 f{ 0.3, 0.92314) 

= 0.96 + 0.2 (-0.51131) = 0.85774. 

Hi) Heun’s method is given by 

y i+ 1 = y t + | Wi, y t ) + fb i+v y t + hff\ 

= y t + 0.1 \ftep y.) + flx i+v y- + 0.2 ff}\. 

Denote y* = y t + 0.2 f., Then, we write the method as 
y i+ 1 = y t + o.l | flXi, y) + flx i+v y .*)] 

We have x 0 = 0, y 0 = 1.0, y 0 ' =f 0 = 0, y * =y 0 + 0.2 f 0 = l,x x = 0.2. 
y(0.2) =y 1 =y 0 + 0.1 \f 0 +flx v y*)\ 

= 1.0 + 0.1[0.0 + /(0.2, 1.0)] 

= 1.0 + 0.1 (-0.4) = 0.96. 
x x = 0.2, y x = 0.96, f x = fl 0.2, 0.96) = -0.36864, 
y x * *y x + 0.2 f x = 0.96 + 0.2 (-0.36864) = 0.88627, x 2 = 0.4. 
y(0.4) =y 2 = y x + 0.1 \f x + f{x 2 , y^)] 

= 0.96 + 0.1 [-0.36864 + fl 0.4, 0.88627)] 

= 0.96 + 0.1 [-0.36864 - 0.62838] = 0.86030. 

The actual errors are given in the following Table 4.3. 


Table 4.3. Errors in modified Euler and Heun’s methods. Example 4.7. 




Modified Euler method 

Heun’s method 

* 

Exact solution 

Num. solution 

| Error \ 

Num. solution 

| Error \ 

0.2 

0.96154 

0.96 

0.00154 

0.96 

0.00154 

0.4 

0.86207 

0.85774 

0.00433 

0.86030 

0.00177 
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- ( REVIEW QUESTIONS ) - 

1. Define truncation error of a single step method for the solution of the initial value problem 

f =/(*, >'), y(x 0 ) = 3'0- 

Solution A single step method for the solution of the given initial value problem is 
given by y i+1 =y t + hi?(x i+1 , x p y i+v y t , h). 

The exact solution y(x ■) satisfies the equation 

y(x i+ 1 ) = y(x t ) + h$(x i+1 , x t , y(x i+1 ), y(x), h) + T i+1 

where T i+1 is called the local truncation error or discretization error. Therefore, the 
Truncation error (T.E.) is defined by 

T i4 = y( x i+\> - y( x i> - h$(x l+1 , x t , y(x i+1 ), y( x j), h). 

2. Define the order of a numerical method for the solution of the initial value problem y' =J{x, y), 

y( x o ) = ^o- 

Solution Let T i+1 define the truncation error of the numerical method. The order of a 
method is the largest integer p for which 

^-T i+1 = CKh p ). 
h 

3. Write the truncation error of the Euler’s method. 

Solution The truncation error of the Euler’s method is 


T.E. = y"(x i + Qh), 0 < 9 < 1. 

4. Write the bound on the truncation error of the Euler’s method. 

Solution The bound on the truncation error of the Euler method (p = 1) is given by 


| T.E. | < ^maxjy"0e)|. 

5. What is the disadvantage of the Taylor series method ? 

Solution Taylor series method requires the computation of higher order derivatives. 
The higher order derivatives are given by 


y' = fix, y), +ff 

dx dy ax J 

±(V + Vdy) + ±(V + Vdy) 

dx dy dx J dy ydx dy dx J 


dy_ 

dx 


= f xx + 2ff xy + f f yy + f y (f x + ff y ), etc. 
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The number of partial derivatives to be computed increases as the order of the derivative 
of y increases. Therefore, we find that computation of higher order derivatives is very 
difficult. 

6. Write the bound on the truncation error of the Taylor series method. 

Solution The bound on the truncation error of the Taylor series method of order p is 
given by 


I T p+1 | = 


where M. = max | y (p+1> (x )|. 

p x 0 £x<,b 

7. What are the orders of ( i ) modified Euler method, (ii) Heun’s method ? 

Solution Modified Euler method and Heun’s method are both second order methods. 


- ( EXERCISE 4.1 ) - 

Solve the following initial value problems using (i) Euler method, (ii) modified Euler method, 
and (iii) Heun’s method with h = 0.1, x e [1, 1.2], Compare with the exact solution. 

1. y' = x + y,y( 1) = 0. 

2. / = ^y 2 ,y(l) = 1. 

3. Find an approximation to y(0.4), for the initial value problem 

y' = x 2 + y 2 , y(0) = 1 

using the Euler method with h = 0.1 and h = 0.2. Extrapolate the results to get a better 
approximation to y(0.4). 

4. Find an approximation to y(1.6), for the initial value problem 

y' = x +y 2 ,y( 1) = 1 

using the Euler method with h = 0.1 and h = 0.2. Extrapolate the results to get a better 
approximation to y(1.6). 

5. Given the initial value problem, 

y' = 2x + cos y, y(0) = 1 

show that it is sufficient to use Euler method with step length h = 0.2 to compute y(0.2) 
with an error less than 0.05. 

6. Use Taylor series method of order four to solve 

y' =x 2 + y 2 , y(0) = 1 
for x e [0, 0.4] with h = 0.2 

7. Apply Taylor series method of second order and Heun’s method to integrate 

y’ = 2x + 3y, y(0) = 1, * s [0, 0.4] 


with h = 0.1. 
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8. Obtain numerical solution correct to two decimals for the initial value problem 

y' = 3x + 4y, y(0) = 1, * e [0, 0.2] 
using the Taylor series method with h = 0.1. 

9. Obtain numerical solution correct to two decimals for the initial value problem 

y' = 3x + y 2 , y(l) = 1, x e [1, 1.2] 
using the Taylor series method with h = 0.1. 

In the following problems, obtain the solution by Taylor series method. 

10. Findy at x = 0.1 ify' = x 2 y - 1, y(0) = 1. {A.U. Nov. / Dec. 2004) 

11. Findy(l.l) given thaty' = x + y, y(l) = 0. ( A.U. Nov. I Dec. 2006) 

12. Find the values y at x = 0.1 and x = 0.2, given 

y' = x + y, y(0) = 1. (A. U. April / May 2005) 

13. Get the value of y at x = h, given 

y' = x + y + xy, y(0) = 1. (A. U. Nov. /Dec. 2006) 

Using the modified Euler method, solve the following initial value problems. 

14. Findy(O.l) ify' = x 2 +y 2 , y(0) = 1. (A.U. Nov. /Dec. 2004) 

15. Find y(0.2), given the initial value problem y' = y - x 2 + 1, y(0) = 0.5. 

(A. U. April /May 2003 ; Nov. / Dec. 2006) 


4.4 RUNGE-KUTTA METHODS 

Integrating the differential equation y' = fix, y) in the interval [x., x i+1 ], we get 

r C r^dx= f‘ +1 f(x,y)dx . (4.42) 

J Xi dx Jx t 

We have noted in the previous section, that y' and hence f (x, y) is the slope of the 
solution curve. Further, the integrand on the right hand side is the slope of the solution curve 
which changes continuously in [x-, x- +1 ]. By approximating the continuously varying slope in 
[x ; , x i+1 ] by a fixed slope, we have obtained the Euler, Heun’s and modified Euler methods. The 
basic idea of Runge-Kutta methods is to approximate the integral by a weighted average of 
slopes and approximate slopes at a number of points in [x ■, x j+1 ]. If we also include the slope at 
Xj + i> we obtain implicit Runge-Kutta methods. If we do not include the slope at x i+1 , we obtain 
explicit Runge-Kutta methods. For our discussion, we shall consider explicit Runge-Kutta meth¬ 
ods only. However, Runge-Kutta methods must compare with the Taylor series method when 
they are expanded about the point x = x-. In all the Runge-Kutta methods, we include the slope 
at the initial point x = x., that is, the slope fix t , y.). 

Runge-Kutta method of second order 
Consider a Runge-Kutta method with two slopes. Define 
k 1 = h fix it yf), 
k 2 = h fix t + cji, y. + a^kj, 
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y i+ 1 = w 1 k 1 + w 2 k 2 (4.43) 

where the values of the parameters c 2 , a 21 , w v w 2 are chosen such that the method is of high¬ 
est possible order. Now, Taylor series expansion about x = x t , gives 

y(x i+ 1 ) =y(x t ) + hy'(x t ) + /'(*;) + f ^y"'(x i ) + ... 

= yiXj) + h f{x p y(x)) + ^(f x + ffy )* s 
+ k ^\ f xx + 2/4 + f% y + f y (f x + ff y )] Xi + ... (4.44) 

We also have k 1 = hf t , 

k 2 = hf{x i + c 2 h, y t + a 21 /i/) 

= h j/ + h(c 2 f x +a 2i ff y ) x . + ^-(clf xx +2c 2 a 2 iff xy + al i f 2 f yy ) x . + ... 

Substituting the values of k 1 and k 2 in (4.43), we get 

y i+ 1 =y- + (w 1 + w 2 ) hf i + h 2 (w 2 c 2 f x + wgi 21 ff y ) Xi 

+ U) 2 (clf xx + 2c 2 a 21 ff xy + a 2 i f 2 fyy ) x . + ... (4.45) 

Comparing the coefficients of h and h 2 in (4.44) and (4.45), we obtain 
w 1 + w 2 = 1, c 2 w 2 = 1/2, a 21 w 2 = 1/2. 

Solving these equations, we obtain 



where c 2 is arbitrary. It is not possible to compare the coefficients of h 3 as there are five terms 
in (4.44) and three terms in (4.45). Therefore, the Runge-Kutta methods using two slopes (two 
evaluations of f ) is given by 

(4 - 46) 

where k 1 = h f[x t , y t ), 

k 2 = h f[x t + cji, y. + c 2 ^ 1 ). 

We note that the method has one arbitrary parameter c 2 . We may choose any value for 
c 2 such that 0 < c 2 < 1. Therefore, we have an infinite family of these methods. 

If we choose c 2 = 1, we obtain the method 

y i+ i=yi + \ (k i + * 2 ) 


(4.47) 
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k 1 = hf{x i ,y i ), k 2 = h fix t +h,y t +kf) 

which is the Heun’s method or Euler-Cauchy method. Therefore, Heun’s method derived in 
the previous section can be written in the formulation of a Runge-Kutta method. 

If we choose c 2 = 1/2, we get w 1 = 0. The method is given by 

y i+ 1 =y t + k 2 (4.48) 

k 1 = hf{x t , y t ), 

** = v (*‘ + 

which is the modified Euler method. Therefore, modified Euler method can also be written in 
the formulation of a Runge-Kutta method. 

Error of the Runge-Kutta method 

Subtracting (4.45) from (4.44), we get the truncation error in the method as 
T.E .=y(x i+1 )-y i+1 

= h 3 - C -fj [f xx + 2 ff xy + f %} + | fy(f x + ffy ) + ...] (4.49) 

Since the truncation error is of order Oih 3 ), the method is of second order for all values 
of c 2 . Therefore, (4.46) gives an infinite family of second order methods. We may note that for 
c 2 = 2/3, the first term inside the bracket in (4.49) vanishes and we get a method of minimum 
truncation error. The method is given by 

y i+ 1 =yi+ ^ (k i + 3k 2 ) (4.50) 

where k 1 = hflx t , yf, 

k 2 = hf (*; + | h, y t + !&ij. 

Therefore, the method (4.50) is a second order method with minimum truncation error. 
Runge-Kutta method of fourth order The most commonly used Runge-Kutta method is a 
method which uses four slopes. The method is given by 

y i+ 1 = y t + ^ (&i + 2k 2 + 2k 3 + kf) 

= hf (x t , yf) 

k 3 = hf[x i +^,y i +^k^ , 
k A = hf(x i + h,y t + k 3 ). 


(4.51) 
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Remark 5 We would like to know as to why the Runge-Kutta method (4.51) is the most 
commonly used method. Using two slopes in the method, we have obtained methods of second 
order, which we have called as second order Runge-Kutta methods. The method has one 
arbitrary parameter, whose value is suitably chosen. The methods using four evaluations of 
slopes have two arbitrary parameters. The values of these parameters are chosen such that 
the method becomes simple for computations. One such choice gives the method (4.51). All 
these methods are of fourth order, that is, the truncation error is of order 0(h 5 ). The method 
(4.51) is called the classical Runge-Kutta method of fourth order. If we use five slopes, we do 
not get a fifth order method, but only a fourth order method. It is due to this reason the 
classical fourth order Runge-Kutta method is preferred for computations. 

Remark 6 All the single step methods (Taylor series, Runge-Kutta methods etc.) are self 
starting. They do not require values of y and/or the values of the derivatives of y beyond the 
previous point. 

Example 4.8 Solve the initial value problem 
y'= - 2xy 2 , y(0) = 1 

with h = 0.2 on the interval [0, 0.4], Use (i) the Heun’s method (second order Runge-Kutta 
method); (ii) the fourth order classical Runge-Kutta method. Compare with the exact solution 
y(x) = 1/(1 + x 2 ). 

Solution 

( i ) The solution using Heun’s method is given in Example 4.7. The solutions are 

y(0.2) « 0.96, y(0.4) « 0.86030. 

(ii) For i = 0, we have x 0 = 0, y 0 = 1. 

k x = hf(x 0 , y 0 ) = -2(0.2)(0)(1) 2 = 0, 



k 3 = hf[x 0 +^,y 0 + ^k 2 j = -2 (0.2)(0.1)(0.98) 2 = -0.038416, 
k 4 = hf(x 0 + h,y 0 + k 3 ) = -2(0.2)(0.2)(0.961584) 3 = -0.0739715, 



= 1.0 + | [0.0 - 0.08 - 0.076832 - 0.0739715] = 0.9615328. 
For i = 1, we have x l = 0, y 1 = 0.9615328. 

k 1 = hf(x v yj = -2(0.2)(0.2)(0.9615328) 2 = - 0.0739636, 
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= hf\x 1 + 


= -2(0.2)(0.3) (0.924551) 2 = - 0.1025753, 


k 3 = hf[x 1 + ~,y 1 + ^& 2 j = -2(0.2)(0.3)(0.9102451) 2 = - 0.0994255, 
k 4 = hf( Xl + h, yi + k 3 ) = -2(0.2)(0.4)(0.86210734) 2 = - 0.1189166, 
;y(0.4) ~y 2 = 3 ^ + ^ (k 1 + 2k 2 + 2k 3 + k 4 ) 


0.1189166] 


= 0.9615328 + \ [-0.0739636 -0.2051506 -0.1988510 - 
6 

= 0.8620525 


The absolute errors in the numerical solutions are given in Table 4.4. 


Table 4.4. Absolute errors in Heun’s method and fourth order Runge-Kutta method. Example 4.8. 




Heun’s 

method 

Runge-Kutta method 

X 

Exact solution 

Num. solution 

| Error \ 

Num. solution 

| Error 

0.2 

0.9615385 

0.96 

0.0015385 

0.9615328 

0.0000057 

0.4 

0.8620690 

0.86030 

0.0017690 

0.8620525 

0.0000165 


Example 4.9 Given y'=x 3 +y, 3 XO) = 2, compute 3 XO.2), 3 XO. 4 ) andy(0.6 ) using the Runge-Kutta 
method of fourth order. (A. U. April / May 2004) 

Solution We have x 0 = 0, y 0 = 2, f{x, y) = x 3 + y, h = 0.2. 

For i = 0, we have x 0 = 0, y 0 = 2. 

k x = hfix 0 , y 0 ) = 0.2 /X0, 2) = (0.2)(2) = 0.4, 

k 2 = hf f*o + |.Vo + \h j = 0 . 2 /( 0 . 1 , 2 . 2 ) 

= (0.2X2.201) = 0.4402, 

k 3 = hf{x 0 + ^,y 0 = 0.2 flfl.l, 2.2201) 

= (0.2X2.2211) = 0.44422, 
k 4 = hf(x 0 + h,y 0 + k 3 ) = 0.2 f (0.2, 2.44422) 

= (0.2X2.45222) = 0.490444, 

y{ 0 . 2 ) ~y x =y 0 + ^ (k 1 + 2k 2 + 2k 3 + kf) 
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= 2.0+| [0.4 + 2(0.4402) + 2(0.44422) + 0.490444] 

= 2.443214. 

For i = 1, we have x 1 = 0.2,3^ = 2.443214. 

k 1 = hf(x v yj = 0.2 f{ 0.2, 2.443214) = (0.2)(2.451214) = 0.490243, 

k 2 = hf + |, 3h + | h j = 0.2 /(0.3, 2.443214 + 0.245122) 

= (0.2X2.715336) = 0.543067, 

k 3 = hf (*i + |, 3h + | k 2 j = 0.2 /(0.3, 2.443214 + 0.271534) 

= (0.2X2.741748) = 0.548350, 
k 4 = hf( Xl + h,y 1 + k 3 ) = 0.2 H 0.4, 2.443214 + 0.548350) 

= (0.2X3.055564) = 0.611113, 

;y(0.4) = y 2 = y 1 + ^ (k 1 + 2k 2 + 2k 3 + k 4 ) 

= 2.443214 + | [0.490243 + 2(0.543067) + 2(0.548350) + 0.611113] 
= 2.990579. 

For i = 2, we have x 2 = 0.4, y 2 = 2.990579. 

k x = hf(x 2 , y 2 ) = 0.2 f( 0.4, 2.990579) = (0.2X3.054579) = 0.610916, 

k 2 = hf \x 2 + |, y 2 +1j = 0.2/(0.5, 2.990579 + 0.305458) 

= (0.2X3.421037) = 0.684207, 

k 3 = hf (x 2 + 1, y 2 + | j = 0.2/ - (0.5, 2.990579 + 0.342104) 

= (0.2X3.457683) = 0.691537, 
k A = hf(x 2 + h,y 2 + k 3 ) = 0.2 f (0.6, 2.990579 + 0.691537) 

= (0.2) (3.898116) = 0.779623. 

3XO.6) ~y 3 = y 2 + ^ (k 1 + 2k 2 + 2k 3 + k 4 ) 

= 2.990579 + | [0.610916 + 2(0.684207) + 2(0.691537) + 0.779623] 


= 3.680917. 
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| REVIEW QUESTIONS J- 


1. Write the Heun’s method for solving the first order initial value problems in the Runge- 
Kutta formulation. 

Solution Heun’s method can be written as follows 


y i+ i=yi + \ + 

k 1 = hf(x i , y t ), 
k 2 = hf{x i + h,y i + k^). 


2. Write the modified Euler method for solving the first order initial value problems in the 
Runge-Kutta formulation. 

Solution Modified Euler method can be written as follows 


y i+ 1 =y t + k 2 


k x = hf{ Xi , y.) 



3. Why is the classical Runge-Kutta method of fourth order, the most commonly used 
method for solving the first order initial value problems ? 

Solution Using two slopes in the method, we can obtain methods of second order, which 
are called as the second order Runge-Kutta methods. The method has one arbitrary 
parameter, whose value is suitably chosen. The methods using four evaluations of slopes 
have two arbitrary parameters. All these methods are of fourth order, that is the trun¬ 
cation error is of order 0(h 5 ). The values of these parameters are chosen such that the 
method becomes simple for computations. One such choice gives the classical Runge- 
Kutta method of fourth order. If we use five slopes, we do not get a fifth order method, 
but only a fourth order method. It is due to this reason, the classical fourth order Runge- 
Kutta method is preferred for computations. 


{ EXERCISE 4.2 ^ 


In the following problems, obtain the solution by the fourth order Runge-Kutta method. 

1. Find /(0.4), f{ 0.6), given the initial value problem y' = y - x 2 + 1, y(0) = 0.5. 


(A. U. April /May 2003 ) 


2 . Solve 


— = ^with y(0) = 1 at x = 0.2. (A. U. April /May 2005, Nov. / Dec. 2004) 

dx y z +x 


3. Find y(0.1) and y(0.2) for the initial value problem y' = x + y 2 , y(0) = 1. 
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4. Find y(0.4) given that y' = x + y 2 , 3 /( 0 ) = 1.3456. Take h = 0.2. 

5. Determine y( 0.2) with h = 0.1, for the initial value problem y' = x 2 + y 2 , 3 /( 0 ) = 1. 

6 . Find an approximate value of y when x = 0.2 and x = 0.4 given that y' = x + y, y(0) = 1, 

with h = 0.2. (A.ZJ. May I June 2006, Nov. I Dec. 2006) 

7. Determine 340 . 2 ), y(0.4) with h = 0.2, for the initial value problem y' = x 3 + 3 y, 3 /( 0 ) = 1. 

8. Solve 


dy ^^x 2 y (0) = 1 at * = 0.2 with h = 0.1. 
dx y + X 


4.5 SYSTEM OF FIRST ORDER INITIAL VALUE PROBLEMS 

In section 4.1, we have discussed the reduction of a second order initial value problem to a 
system of first order initial value problems. For the sake of completeness, let us repeat this 
procedure. 

Let the second order initial value problem be given as 

a 0 (x) y"(x) + a^x)y\x) + a 2 (x)y(x) = r(x) (4.52) 

yfe 0 ) = b 0 , y'(^ 0 ) = b r 


Define u 1 = y. Then, we have the system 

%' = / = u 2 , u^xj = b 0 , 

1 


u, 2 = y” = —— [r(x) - a x (x) y'(x) - a 2 (x) y(x)] 
a 0 (x) 


a 0 (x) 


[r(x) - a x (x) u 2 - a 2 (x) uj, u 2 (x 0 ) = b r 


The system is given by 


r«ii = \ u 2 1 r“i(%)] = po] 

\u 2 \ \f 2 (x,U 1 ,U 2 )y L“2^o)J L fo l J 


where f 2 (x, u v u 2 ) = —-— [r(x) - a^x) u 2 — a 2 (x) wj. 

a 0 (x) 

In general, we may have a system as 


>1] 4A<*,yi,y 2 >l bi^o)] 
y%\ [f2^,y v y 2 )y Lya(*o)J 


In vector notation, denote 


(4.53) 


(4.54) 


y = \y v y^ T , f = \f v f^ T , b = K> 0 , b^\ T . 
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Then, we can write the system as 

y' = fix, y), 

y(x 0 ) = b. (4.55) 

Therefore, the methods derived for the solution of the first order initial value problem 
dy 

= fix, y ), y(x 0 ) = y 0 (4.56) 

can be used to solve the system of equations (4.54) or (4.55), that is, the second order initial 
value problem (4.52), by writing the method in vector form. 


4.5.1 Taylor Series Method 

In vector format, we write the Taylor series method (4.20) of order p as 


where 


h 2 „ h p ( - 

y i+ , = y l + hy' + ^y i +.„+—y\ p 



~ d k ~ x ,, 

wn 


kr 

d k ~ X 

~v~k=i hi^i,y\i,y 2 ,d 

L dx J 


In component form, we obtain 


(y i)j+i= (Vi)j + hiyf). + —(y/h + ■■■ + ^iy[ p) h . 

(y 2 ) i+ 1 = (y 2 \ + h(y 2 '\ + \ (y 2 " >* + ••• + ^ ^ \ ■ 
Euler’s method for solving the system is given by 

^y-s)i+i~ (ydi + h(y{)i = (y^ + h f x ix t , (y x )., (y 2 )p. 

(y 2 ) i+1 = iyf>i + h iyf\ = (y 2 )i + h f4*i> iy\\> OkP- 


(4.57) 


(4.58) 

(4.59) 

(4.60) 

(4.61) 


4.5.2 Runge-Kutta Fourth Order Method 

In vector format, we write the Runge-Kutta fourth order method (4.51) as 


k2 “fe]’ k3 -ft:} k4_ fc] 


Kl = h fn( X i’ ( yi\’ ( y 2 \'*> n=l,2. 

k n2 = h f n (** + \ >Cyi). + 1 Ki, (y 2 )i + 1 Ki j, n = l, 2. 


(4.62) 


where 


(4.63) 





INITIAL VALUE PROBLEMS FOR ORDINARY DIFFERENTIAL EQUATIONS 


209 


Ks = hfn (*< + |. Cyi)i + 1*12, (M +\ * 22 ], n = 1, 2. 

& n4 = M n ( x i + *> CVi)i + *13> + *23^’ ft = 1, 2. 

Note that we have used the matrix notation for representing the column vectors k x , k 2 , 
k 3 , k 4 . Some books use the notation (k v Z 1 ), (k 2 , l 2 ), (k 3 , l 3 ), (k 4 , Z 4 ) for representing the column 
vectors k 4 , k 2 , k 3 , k 4 . 

In explicit form, we write the method as 


(y x ) i+ i = (yJi + ^ (*u + 2k 12 + 2k 13 + k u ), 
(y 2 )j + i = (y 2 )j + g (* 2 1 + 2 *22 + 2 *23 + *24)• 

If we denote y 1 = u,y 2 = v, then we can write the equations as 




4 ), 

(4.64) 

= V i + \ <*21 

+ 2^22 ^^23 ^2- 

4 ). 

(4.65) 


Example 4.10 Solve the initial value problem 

u'=-3u + 2v, u( 0) = 0 


v'= 3u-4v, i;(0) = 0.5, 

with h = 0.2 on the interval [0, 0.4], using the Runge-Kutta fourth order method. 
Solution For i = 0, we have x 0 = 0 ,u 0 = 0, v 0 = 0.5. 

k n = hfpQ, u 0 , v 0 ) = 0.2 (-3 u 0 + 2v 0 ) = 0.2(0 + 2(0.5)) = 0.2. 
* 21 = hf 2 (x o, u 0 , v 0 ) = 0.2 (3 u 0 - 4u 0 ) = 0.2(0 -4(0.5)) = -0.4. 

k 12 = h f\ (*o + \ > u o + \ *ii» + \ *21 j 

= 0.2 4(0.1, 0 + 0.1, 0.5 - 0.2) = 0.2 4(0.1, 0.1, 0.3) 

= 0.2[- 3(0.1) + 2(0.3)] = 0.06. 


*22 = h f 1 (*0 + |. “0 + \ * 11 , D 0 + | *21 j 

= 0.2 4 (0.1, 0.1, 0.3) = 0.2[3(0.1) - 4(0.3)] = -0.18. 
*13 = *A (^ 0 + 2^ ’ + 2 * 12 ’ U ° + 2 * 22 ) 


= 0.2 4(0.1, 0.03, 0.5 - 0.09) = 0.2 4(0.1, 0.03, 0.41) 
= 0.2 [-3(0.03) + 2(0.41)] = 0.146. 
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623 = h f 2 (*0 + | > u 0 + \ k 12> V 0 +^ k 22 j 

= 0.2 f 2 (0.1, 0.03, 0.41) = 0.2 [3(0.03) - 4(0.41)] = - 0.31. 

A i 4 = hf-^ (x 0 + h, u 0 + k 13 , v 0 + k 23 ) 

= 0.2 ft 0.2, 0.146, 0.5 - 0.31) = 0.2 f x ( 0.2, 0.146, 0.19) 

= 0.2 [- 3(0.146) + 2(0.19)] = - 0.0116. 

624 = (* 0 + h > U 0 + k 13’ V 0 + k 23 ) 

= 0.2 f 2 (0.2, 0.146, 0.19) = 0.2 [3(0.146) - 4(0.19)] = - 0.0664. 
u(0.2) = u 1 = u 0 + — ( k n + 2k 12 + 2k 13 + k u ) 

= 0 + | (0.2 + 0.12 + 0.292 - 0.0116) = 0.1001. 
u(0.2) ~v 1 = v 0 + ^ ( k 2l + 2k 22 + 2k 23 + k 2i 4 ) 

= 0.5 + | (- 0.4 - 0.36 - 0.62 - 0.0644) = 0.2593 
For / = 1, we have x 1 = 0.2, u 1 = 0.1001, v 0 = 0.2593. 

k n = tffov u v u i) = 0.2 (- 3«! + 2v-^) 

= 0.2[- 3(0.1001) + 2(0.2593)] = 0.0437. 
k 21 = hf 2 {x v u v v x ) = 0.2 (3«! - 40^ 

= 0.2[3(0.1001) - 4(0.2593)] = - 0.1474. 

k 12 = hf x + 2 > u i + 2^ 11,Vl + 2 ^ 21 ] 

= 0.2 f x (0.3, 0.1220, 0.1856) 

= 0.2 [- 3(0.1220) + 2(0.1856)] = 0.0010. 

&22 = M2 f*l + > U 1 + g V 1 + g *21J 

= 0.2 f 2 (0.3, 0.1220, 0.1856) 

= 0.2[3(0.1220) - 4(0.1856)] = - 0.0753. 

= 0.2 ^(0.3, 0.1006, 0.2217) 

= 0.2 [-3(0.1006) + 2(0.2217)] = 0.0283. 
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&23 = h U (*1 + \ > U 1 + \ ^12. V 1 + \ &22 j 

= 0.2 f 2 (0.3, 0.1006, 0.2217) 

= 0.2 [3(0.1006) - 4(0.2217)] = - 0.1170. 

Ai4 = hf^ + h,u 1 + k 13 , v 3 + k 23 ) 

= 0.2 4(0.4, 0.1284, 0.1423) 

= 0.2 [- 3(0.1284) + 2(0.1423)] = - 0.0201. 
k 24 = hf 2 (x 1 + h,u 1 + k 13 , v 1 + k 23 ) 

= 0.2 f 2 (0.4, 0.1284, 0.1423) 

= 0.2[3(0.1284) - 4(0.1423)] = - 0.0368. 

u(0.4) ~ u 2 = u 1 + — ( k u + 2k 12 + 2k 13 + k u ) 

= 0.1001 + |(0.0437 + 0.0020 + 0.0566 - 0.0201) = 0.1138. 
i>(0.4) ~v 2 = v 1 + ^ ( k 21 + 2k 22 + 2k 23 + k 2i j) 


= 0.2593 + - (- 0.1474 - 0.1506 - 0.2340 - 0.0368) = 0.1645. 


Example 4.11 Compute approximations to y(0A) and y'(OA), for the initial value problem 
y"+ 4y = cos t, 3/(0) = 1, /(0) = 0 

using (i) Taylor series method of fourth order, Hi) Runge-Kutta method of fourth order, with 
step length h = 0.2. If exact solution is given by y{t) = (2 cos 21 + cos t)/ 3, find the magnitudes of 
the errors. 

Solution Let y = u. Reducing the given second order equation to a system of first order 
equations, we obtain 

u' = v, u( 0) = 1, 


v' = cos t - 4y = cos t - 4u, v(0) = 0. 
(i) Taylor series method of fourth order gives 


„ 0.008 0.0016 

= u ■ + 0.2 u + 0.02 u + —-— u t + ——— u 

1 1 1 6 24 


, h 2 „ h A h (4 

. = V; + kV: + - Vj + V,- + - V) 

11 1 2 1 6 1 24 1 
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We have 

For i = 0: u. 


For i = 1: 


= V- + 0.2 v- + 0.02v" + - 


u' = v,v' = cos t — 4u, u" = o', v" = - sin t — 4 u', 
u'" = v", v'" = - cos t - 4u", u IA) = v'", i/ 4) = sin t - 4u'". 


= 1 . v 0 = 0 , t 0 = 0 . 

u o = v 0 = v o = 4 ~ 4 u 0 = 1 - 4 = - 3, Uq = Vq = - 3, Vq = - 4u 0 ' = 0, 

u'o = v o = v o = - 1 - 4 mq = - 1 + 12 = 11, 

“o 4) = v o = n > u o 4) = - 4 “o = °- 


u{ 0.2) = u x ■= u 0 + 0.2 uq + 0.02u 0 " 


0.008 


0.0016 
L- U 

24 


= 1 + 0 + 0.02 (- 3) + 0 + 


0.0016 

24 


(11) = 0.940733 


= v n + 0.2v n ' + 0.02v n " + - 


0.0016 

i-- v 

24 


u x = 0.940733, v 1 = - 0.585333, t 1 = 0.2. 
u \ = v x = - 0.585333, 

v{ = cos (0.2) - 4 Ul = 0.980067 - 4(0.940733) = - 2.782865, 
u" = Vx' = - 2.782865, 

v" = - sin (0.2) - 4 u[ = - 0.198669 - 4(- 0.585333) = 2.142663, 
u'" = v" = 2.142663, 

v"' = - cos (0.2) - 4 u" = - 0.980067 - 4(- 2.782865) = 10.151393, 
w< 4) = v" = 10.151393, 

u{ 4) = sin (0.2) - 4u'x = 0.198669 - 4(2.142663) = - 8.371983. 


u(0.4) = u 2 = Ux + 0.2 Ux + 0.02^/' + — u"'+ — M i 

= 0.940733 + 0.2(- 0.585333) + 0.02(- 2.782865) 

0.008 0.0016 

+ —— (2.142663) + 24 (10.151393) = 0.771543. 


u(0.4) = v 2 = Vx + 0.2 v'x + 0.02 v" + 


0.008 0.0016 
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= - 0.585333 + 0.2(- 2.782865) + 0.02(2.142663) 



0.0016 

24 


(- 8.371983) = - 1.086076. 


The exact solutions are 


u( 0.2) = | [2 cos (0.4) + cos (0.2)] = 0.940730. 


o(0.2) = - | [4 sin (0.4) + sin (0.2)] = - 0.585448. 


u(0.4) = | [2 cos (0.8) + cos (0.4)] = 0.771491. 


o(0.4) = - | [4 sin (0.8) + sin (0.4)] = - 1.086281. 


The magnitudes of errors in the solutions are 

| u(0.2) - u x | = | 0.940730 - 0.940733 | = 0.000003, 

| (0.2) - Oj | = | - 0.585448 + 0.585333 | = 0.000115, 

| u(0.4) - u 2 | = | 0.771491 - 0.771543 | = 0.000052, 

| y(0.4) - v 2 | = |- 1.086281 + 1.086076 | = 0.000205. 

(ii ) For i = 0, we have t 0 = 0 ,u 0 = 1, v 0 = 0, f-^u, v ) = v, f 2 (u, v ) = cos t - 4u. 


k u = hf^, u 0 , v 0 ) = hf^O, 1, 0) = 0. 

*2i = hf 2 (t 0 , u 0 , v 0 ) = hf 2 ( 0, 1, 0) = 0.2 (1 - 4) = - 0.6. 



= 0.2 4(0.1, 1 + 0.0, 0.0 - 0.3) = 0.2 4(0.1, 1.0, - 0.3) 
= 0.2 (- 0.3) = - 0.06. 



= 0.2 4 (0.1, 1.0, - 0.3) = 0.2 [cos (0.1) - 4] = - 0.600999. 



= 0.2 4(0.1, 1.0 - 0.03, 0.0 - 0.3004995) 
= 0.2 4(0.1, 0.97, - 0.3004995) 

= 0.2 (- 0.3004995) = - 0.060100. 
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= 0.2 f 2 (0.1, 0.97, - 0.3004995) 

= 0.2 [cos (0.1) - 4(0.97)] = - 0.576999. 


* 14 = h fi (t o + h,u 0 + k 13 , v 0 + k 23 ) 


= 0.2 4(0.2, 1.0 - 0.060100, - 0.576999) 
= 0.2 4 (0.2, 0.939900, - 0.576999) 

= 0.2 (- 0.576999) = - 0.115400. 


*24 = h fp 0 + h,U 0 + k 13 , V 0 + k 23 ) 


= 0.2 4(0.2, 0.939900, - 0.576999) 

= 0.2 [cos (0.2) - 4(0.939900)] = - 0.555907. 


u{ 0.2) ~ u 1 = u 0 + — ( k u + 2k 12 + 2k 13 + k u ) 


1 


= 1.0 + ^[0.0 + 2(- 0.06) + 2(- 0.060100) - 0.115400] = 0.940733. 


v(0.2) = V] 


V Q + — (*2i + 2*22 + 2*23 + *24^ 


1 


= 0.0 + - [- 0.6 + 2(- 0.600999) + 2(- 0.576999) - 0.555907] 
6 

= - 0.585317. 

For j = 1, we have t 1 = 0.2, u 1 = 0.940733, v x = - 0.585317. 

k n = hf x (4, u v V j) = 0.2 4 (0.2, 0.940733, - 0.585317) 

= 0.2[- 0.585317] = - 0.117063. 
k 21 = hf 2 (t v u v vj) = h 4(0.2, 0.940733, - 0.585317) 

= 0.2 [cos (0.2) - 4(0.940733)] = - 0.556573. 



= 0.2 4(0.3, 0.882202, - 0.863604) 
= 0.2 (- 0.863604) = - 0.172721. 



= 0.2 4 (0.3, 0.882202, - 0.863604) 

= 0.2 [cos (0.3) - 4(0.882202)] = - 0.514694. 
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* U = V,(‘l + f.»l+ 

= 0.2 ^(0.3, 0.854372, - 0.842664) 

= 0.2 [- 0.842664] = - 0.168533. 

^23 = h h [*i + f > “1 + \ k M’ v i + \ k 22 j 
= 0.2 f 2 (0.3, 0.854372, - 0.842664) 

= 0.2 [cos (0.3) - 4(0.854372)] = - 0.492430. 
k u = hf 1 (t 1 + h, u 1 + k 13 , v 1 + k 23 ) 

= 0.2 f x (0.4, 0.772200, - 1.077747) = 0.2 [- 1.077747] = - 0.215549. 
&24 = hf 2 (t x + h, u x + k 13 , v x + k 23 ) 

= 0.2 f 2 ( 0.4, 0.772200, - 1.077747) 

= 0.2 [cos (0.4) - 4(0.772200)] = - 0.433548. 

u(0.4) ~ u 2 = u x + ( k u + 2k 12 + 2k 13 + k u ) 

= 0.940733 + ~ [-0.117063 + 2(- 0.172721) + 2(- 0.168533) - 0.215549] 
= 0771546. 

o(0.4) ~ u 2 = v x + ^ ( k 21 + 2k 22 + 2k 23 + k 2i ) 

= - 0.585317 + | [- 0.556573 + 2(- 0.514694) + 2(- 0.492430) - 0.433548] 
= - 1.086045. 

The magnitudes of errors in the solutions are 

| u(0.2) - itj | > | 0.940730 - 0.940733 | = 0.000003, 

| o(0.2) - ajj = | - 0.585448 + 0.585317 | = 0.000131, 

| u(0.4) -u 2 | = | 0.771491 - 0.771546 | = 0.000055, 

| o(0.4) - v 2 | = | - 1.086281 + 1.086045 | = 0.000236. 

- ( EXERCISE 4.3 ] - 

Reduce the following second order initial value problems to systems of first order initial value 
problems. 

1. y" + 3 y' + 2\y = e 2i , withy(0) = 1 andy'(O) = 1. 
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2. y" - Qy' + 5y = sin 2 1, withy(O) = 0 and y'(0) = 1. 

3. y” - 2 y' + y = te*, with y(0) = 0.5 and y'(0) = 0.8. 

Solve the following second order initial value problems by Taylor series method. 

4. y" - 2 y' + 2 y = e 2t sin t, with y(0) = - 0.4 and y'(0) = - 0.6. Find y(0.1). 

(A. U.April /May 2003) 

5. y" + 3 y' + 2y = e l , with y(0) = 1 and y'(0) = 1. Find y(0.2) with h = 0.2. 

6. y" - 4 y' + 4y = e 2t , with y(0) = 0.5 and y'(0) = 1. Find y(0.2) with h = 0.1. 

7. y" - 6y' + 5 y = e l , with y(0) = 0 and y'(0) = - 1. Find y(0.1) with h = 0.1. 

In the following second order initial value problems, obtain the solution by the fourth order 
Runge-Kutta method. 

8. Consider the second order initial value problem 

y" - 2 y' + 2 y = e 2t sin t, with y(0) = - 0.4 and y'(0) = - 0.6. 

Find y(0.2). (A. U. April /May 2003) 

9. Given y" + y' + y = 0, y(0) = 1, y'(0) = 0, find the value ofy(O.l). ( A.U. Nov. /Dec. 2006) 

10. y" + 3 y' + 2y = e l , with y(0) = 1 and y'(0) = 1. Find y(0.2) with h = 0.1. 

11. y" + 2 y' + y = te l , withy(0) = 0.5 andy'(0) = 0.8. Findy(0.2) with h = 0.2. 

12. What are the values of k 1 and Z 1 in the Runge-Kutta method of fourth order, to solve 

y" +xy'+y = 0, y(0) = 1, y'(0) = 0. (A. U. April /May 2005) 


4.6 MULTI STEP METHODS AND PREDICTOR-CORRECTOR METHODS 


In section 4.2, we have defined the explicit and implicit multi step methods for the solution of 
the initial value problem 


y' = fix, y), y(x 0 ) = b 0 . 

A general &-step explicit method can be written as 

y i+ 1 = Vi = h ^ x i-k + v •••> X i—V x i> yi-k + 1- 
and a general &-step implicit method can be written as 

y i+ 1 =Vi = h ^ x i-k + 1 > •••> x r x i + v yi-k + i> 



(4.66) 

y t _ i, y t , h) 

(4.67) 

y t , y i+ 1 , h). 

(4.68) 


Remark 7 Multi step methods are not self starting, since a &-step multi step method requires 
the& previous values^, y i V ...,y i A , +1 . The& values that are required for starting the application 
of the method are obtained by using some single step method like Euler’s method, Taylor 
series method or Runge-Kutta method, which is of the same or lower order than the order of 
the multi step method. 
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Let us construct a few multi step methods. 

Integrating the differential equation y' = fix, y ) in the interval [x,, x, + f, we get 

J 1 ^ dx = J ‘ +1 fix, y) dx. 


or y(x i+ 1 ) = yix,) + J ‘ +1 fix, y) dx . (4.69) 

To derive the methods, we approximate the integrand fix, y) by a suitable interpolation 
polynomial. 

In general, we may integrate the differential equation y' = fix, y) in the interval 
\ x i-m> x i+ J • We get 

J 1 = J ‘ +1 fix,y)dx 

or yix i+ 1 ) = yix,_ m ) + [ ‘ +1 fix, y) dx. 

J X lm 

For m = 0, we get (4.69). 

4.6.1 Predictor Methods (Adams-Bashforth Methods) 

All predictor methods are explicit methods. 

We have& data values, (x it ffix^^ /)_]), •••, ix,_ k+1 , fi-k+J- F° r this data, we fit the Newton’s 
backward difference interpolating polynomial of degree k - 1 as (see equation (2.47) in 
chapter 2) 

g(g + 1) 

P k _fx) = fix, + sh) = fxf + sWfixf + V 2 fix,) + ... 


s(s+l)(s + 2)...(s + &-2) f( , x 
+ O^D! V nXil 

Note that s = [(x - x,)/h\ < 0. 

The expression for the error is given by 


(4.70) 


T.E. = s ( s + l)(s + 2)... is + k 1) fk) (q (4.71) 

(A)! 

where % lies in some interval containing the points x,, x,_ v ..., x,_ k+1 and x. We replace fix, y) by 
PkJx) in (4.69). The limits of integration in (4.69) become 
for x = x,, s = 0 and for x = x, +v s = 1. 

Also, dx = hds. We get 


y , + 1 =y, + h £ ^ + sVf, +1 sis + 1) V 2 f t +1 s(s + l)(s + 2 )V 3 f, + ...j ds 
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Now, f sck = -, f s(s +1) ds = — , 

Jo 2 Jo 6 

f 1 s(s + l)(s + 2 )ds = ~, f 1 s(s + lXs + 2)(s + 3 )ds = —. 
Jo 4 Jo 30 

Hence, we have 


h —V 2 f i + -V 3 f i + — V 4 f i + .. 
12 1 8 1 720 1 


These methods are called Adams-Bashforth methods. 
Using (4.71), we obtain the error term as 


= h k+1 f 1 

Jo 


s(s + DCs + 2)... (s + & - 1) 


f (k) (£) ds 


(4.72) 


= h k+1 £ g(s) f (k) (^ ds. (4.73) 

Since, g{s) does not change sign in [0, 1], we get by the mean value theorem 

T k = h k+1 fW(.?, 1 ) J g(s)ds, 0 < ^ < 1 (4.74) 

where g(s ) = yr [s(s + 1) ... (s + k - 1)]. 

h ! 

Alternately, we write the truncation error as 
T.E. = y(x n+1 ) -y n+1 

Using Taylor series, we expand y(x n+1 ), y n+l about x n , and simplify. The leading term 
gives the order of the truncation error. 

Remark 8 From (4.74), we obtain that the truncation error is of order 0(h k+1 ). Therefore, a k- 
step Adams-Bashforth method is of order k. 

By choosing different values for k, we get different methods. 
k = 1: We get the method 

y i+ i=yi + h fi ( 4 . 75 ) 

which is the Euler’s method. Using (4.74), we obtain the error term as 

Therefore, the method is of first order. 
k = 2: We get the method 

fy + i =y t + h [f i + ± v/)j«,* + *[/! + !(/• - /;-_i)] 
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=y i + \w l -fa- 

For using the method, we require the starting values y ■ and y t _ 
Using (4.74), we obtain the error term as 


Therefore, the method is of second order. 
k = 3: We get the method 




=* + t\fi +1M - /U> + £ « - a/l-i + /U)l 


= y,+ 4 [23/, - 16 /- m + 5/;_ 2 l. 

For using the method, we require the starting values y i? y t l and y L _ 
Using (4.74), we obtain the error term as 

t 3 = | h 4 f^ (y = | h 4 / 4 xy. 

Therefore, the method is of third order. 
k = 4: We get the method 


¥h\fi+- 


(4.76) 


(4.77) 


= y i + h\f i + \ (. fi - h-d + ^ (fi - 2/J_i + /)_ 2 ) +1 (fi - 3fi 4 + 3fi_ 2 - /5_a)J 

= y t + ^ [55/; - 59/^ + 37 fi_ 2 - 9/--_ 3 ]. (4.78) 

For using the method, we require the starting values y t , y i V y i 2 and y i3 
Using (4.74), we obtain the error term as 

U'>V (4) (5,)=|i/.V a S, ) . 

Therefore, the method is of fourth order. 

Remark 9 The required starting values for the application of the Adams-Bashforth methods 
are obtained by using any single step method like Euler’s method, Taylor series method or 
Runge-Kutta method. 
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Example 4.12 Find the approximate value of y( 0.3) using the Adams-Bashforth method of 
third order for the initial value problem 

y' = x 2 +y 2 , y(0) = 1 

with h = 0.1. Calculate the starting values using the corresponding Taylor series method with 
the same step length. 

Solution We have fix, y) = x 2 + y 2 , x 0 = 0, y 0 = 1. 

The Adams-Bashforth method of third order is given by 

y M = y t + + 

We need the starting values, y 0 , y v y 2 . The initial condition gives y 0 = 1. 

The third order Taylor series method is given by 


, , h 2 „ h 3 

y i+1 =yi + hy l + — yi + - yi . 

We have y' = x 2 + y 2 , y" = 2x + 2 yy', y"' = 2+2 \yy" + (y') 2 ]. 

We obtain the following starting values. 

j = 0 : x 0 = 0, y 0 = 1, y 0 ' = 1, y£ = 2, y= 8. 


^ , 0.01 „ 0.001 
y(0.1)=y 1 = y 0 + 0.1y 0 + —- y 0 +—y 


= 1 + 0.1(1) + 0.005(2) + (8) = 1.111333. 

1 = 1:*! = 0.1, yi = 1.111333, y[ = 1.245061, 
yf = 2.967355, y"' = 11.695793. 


, 0.01 „ 0.001 

y(0.2)=y 2 =y 1 + 0.1y 1 + —— y x +—g~y 


= 1.111333 + 0.1(1.245061) + 0.005 (2.967355) + (11.695793) 

= 1.252625. 

Now, we apply the given Adams-Bashforth method. We have 

x 2 = 0.2, y 2 = 1.252625, y 2 ' =f 2 = 1.609069. 

For i = 2, we obtain 

y(0.3) =y 3 =y 2 + A [23 f 2 - 1 6f, + 5 f 0 ] 

= y 2 + ^ [23(1.609069) - 16(1.245061) + 5(1)] = 1.436688. 
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Example 4.13 Find the approximate value of y(0A) using the Adams-Bashforth method of 
fourth order for the initial value problem 

y' = x +y 2 , y(0) = 1 

with h = 0.1. Calculate the starting values using the Euler’s method with the same step length. 
Solution We have fix, y) = x + y 2 , x 0 = 0, y 0 = 1. 

The Adams-Bashforth method of fourth order is given by 

> i+ i =3-+ 2 4 [55 ^ - 59 f^ + 37 f t _ 2 - 9 f.J. 

We need the starting values, y 0 , y v y 2 , y 3 . The initial condition gives y 0 = 1. 

Euler’s method is given by 

yi^yi + hy^yi + hf. 

We obtain the following starting values. 

i = 0: ^o = 0 >3' 0 = 1 >V=/o= 1 

y(0.1) ~y 1 =y 0 + 0.1 y 0 '= 1 + 0.1(1) = 1.1. 
i= 1: x 1 = 0.1, y x = 1.1, y{ = fi 0.1, 1.1) = 1.31. 

y(0.2) *=y 2 = y 1 + 0.1 yf = 1.1 + 0.1(1.31) = 1.231. 
i = 2 : x 2 = 0.2, y 2 = 1.231, y 2 ' = fi 0.2, 1.231) = 1.715361. 

y(0.3) =y 3 = y 2 + 0.1 y 2 ' = 1.231 + 0.1(1.715361) = 1.402536. 

Now, we apply the given Adams-Bashforth method. We have 

x 3 = 0.3, y 3 = 1.402536, y 3 ' =f 3 = 2.267107. 

For i = 3, we obtain 

y(0.4) - y 4 = y 3 + ^ [55 f 3 - 59 f 2 + 37/\ - 9fJ 
0.1 

= 1.402536 + — [55(2.267107) - 59(1.715361) + 37(1.31) - 9(1)] 

= 1.664847. 

4.6.2 Corrector Methods 

All corrector methods are implicit methods. 

4.6.2.1 Adams-Moulton Methods 

Consider the k + 1 data values, ix i+1 , f i+1 ), (x i , /■), (x iV f t _f), ..., {x t _ k+v f t _ k+1 ) which include the 
current data point. For this data, we fit the Newton’s backward difference interpolating poly¬ 
nomial of degree k as (see equation (2.47) in chapter 2) 
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P k {x) = fix, + sh ) = f[x i+1 ) + (S - 1) Vflx i+1 ) + 


(s - l)s 
2! 


V 2 flXiJ + ... 


(s- l)s(s + l)(s + 2 )...(s + k-2) j. ( s 

m nXi+l) 

where s = [(x - xff/h] < 0. 

The expression for the error is given by 


T.E. = 


(s - l)s(s + l)(s + 2)... (s + k - 1) 

(A + D! 


h k + i f(k + i) 


(4.79) 


(4.80) 


where % lies in some interval containing the points x i+1 , x i ,..., x nk+1 and x. We replace fix, y ) by 
P k (x ) in (4.69). The limits of integration in (4.69) become 
for x = x t , s = 0, and for x = x i+1 , s = 1. 

Also, dx = hds. We get 

3^1 =y t + h £ + <8 -l) Wui +1 (8 - 1).vVw 


1 

6 


l)s(s + 1)V 3 f i+1 +... ds 


Now, = = 

r 1 19 

(s - l)s(s + l)(s + 2) ds = - —. 

Jo 30 

Hence, we have 


These methods are called Adams-Moulton methods. 

Using (4.80), we obtain the error term as 

T k = h™ £ (»-W. + M. +2).■■(. + *-1) f(ktl)(?) ds 

= h k * 2 f'gls)/■“*“©* 

Jo 


(4.81) 


(4.82) 
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where g(s ) = ^ +^ [(s - l)s(s + 1) ... (s + k- 1)]. 

Since g(s) does not change sign in [0, 1], we get by the mean value theorem 

T k = h k+2 /-« +1 > (y J*.) ds, 0 < < 1. (4.83) 

Remark 10 From (4.83), we obtain that the truncation error is of order 0(h k+2 ). Therefore, a 
&-step Adams-Moulton method is of order k + 1. 

By choosing different values for k, we get different methods. 
k = 0 : We get the method 

yi + i = yi + h fi + i (4 - 84) 

which is the backward Euler’s method. Using (4.83), we obtain the error term as 

Therefore, the method is of first order. 
k = 1: We get the method 

y j+ i =y t + h [f i+1 -| v/; + 1 j =y i + h [f i+1 -| (f i+1 - /*,)] 

=*,+ § Vi+i+fil- ( 4 - 85 ) 

This is also a single step method and we do not require any starting values. This method 
is also called the trapezium method. 

Using (4.83), we obtain the error term as 

T = - 4*»/-<y = - 

Therefore, the method is of second order. 
k = 2: We get the method 

= y + h [f M - \(f i+l -/))- ^(f i+1 - 2 f t + /■_!)! 

= y t + ~ [5/j + ! + 8^ J. 


(4.86) 



224 


NUMERICAL METHODS 


For using the method, we require the starting values y j, 
Using (4.83), we obtain the error term as 

Therefore, the method is of third order. 
k = 3: We get the method 

r 1 1 o ] 

7 V %i-o 


_ yy . +1 


Vi+ 3^-1-W] 


= 57 + 24 ©/m + IV, - V-i + f,J- (4.87) 

For using the method, we require the starting values y., y- v y l 2 . 

Using (4.83), we obtain the error term as 

Therefore, the method is of fourth order. 

4.6.2.2 Milne-Simpson Methods 

To derive the Milne’s methods, we integrate the differential equation y' = fix, y) in the interval 
[x._ 15 x. +] ]. We get 


1 1 dx dX = \ x + ^ X,y ^ dX - 


y(x i+1 ) =y(x i _ 1 ) + p +1 f(x,y)dx ■ 

Le methods, we use the same appj 
-Moulton methods. The interval < 

3^1 = y t -i + h £ \f l+l +(«-!) Wi* + \ (8 -1 )sV 2 f M 


To derive the methods, we use the same approximation, follow the same procedure and 
steps as in Adams-Moulton methods. The interval of integration for s is [- 1, 1]. We obtain 


ds 
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Now, J (s - 1) ds = - 2, 

r i 2 

(s - l)s ds = —, 

Jo 8 

J (s - l)s(s + 1) ds = 0, J 

(s - l)s(s + l)(s + 2) ds = 

Hence, we have 



^ + i =3Vi + h [2 f i+1 - 2 Wf i+1 + | V 2 f i+ 1 + (0) W 3 f i+ 1 - ^ V% 1 - ...]. (4.89) 

These methods are called Milne’s methods. 

The case k = 2, is of interest for us. We obtain the method as 

y i+ 1 = + ft [ 2 /i+i “ 2 V /i+i + g v 2 /i+ij 

= + ft [2 f i+1 - 2 (f i+1 -fi) + \ (. fi + x - 

= i4i +4 /; + 4J* (4-90) 

This method is also called the Milne-Simpson’s method. 

For using the method, we require the starting values y ■, y i V 
The error term is given by 

^-£aV“W-£*V»W. 

Therefore, the method is of fourth order. 

Remark 11 The methods derived in this section are all implicit methods. Therefore, we need 
to solve a nonlinear algebraic equation for obtaining the solution at each point. Hence, these 
methods are not used as such but in combination with the explicit methods. This would give 
rise to the explicit-implicit methods or predictor-corrector methods, which we describe in the 
next section. 

4.6.2.3 Predictor-Corrector Methods 

In the previous sections, we have derived explicit single step methods (Euler’s method, Taylor 
series methods and Runge-Kutta methods), explicit multi step methods (Adams-Bashforth 
methods) and implicit methods (Adams-Moulton methods, Milne-Simpson methods) for the 
solution of the initial value problem y' = fix, y), y(x Q ) = y Q . If we perform analysis for numerical 
stability of these methods (we shall discuss briefly this concept in the next section), we find 
that all explicit methods require very small step lengths to be used for convergence. If the 
solution of the problem is required over a large interval, we may need to use the method 
thousands or even millions of steps, which is computationally very expensive. Most implicit 
methods have strong stability properties, that is, we can use sufficiently large step lengths for 
computations and we can obtain convergence. However, we need to solve a nonlinear alge- 
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braic equation for the solution at each nodal point. This procedure may also be computationally 
expensive as convergence is to be obtained for the solution of the nonlinear equation at each 
nodal point. Therefore, we combine the explicit methods (which have weak stability proper¬ 
ties) and implicit methods (which have strong stability properties) to obtain new methods. 
Such methods are called predictor-corrector methods or P-C methods. 

Now, we define the predictor-corrector methods. We denote P for predictor and C for 
corrector. 

P: Predict an approximation to the solution y i+l at the current point, using an explicit 
method. Denote this approximation as y^\. 

C: Correct the approximation y\^[, using a corrector, that is, an implicit method. Denote 
this corrected value as y { P r The corrector is used 1 or 2 or 3 times, depending on the 
orders of explicit and implicit methods used. 

Remark 12 The order of the predictor should be less than or equal to the order of the corrector. 
If the orders of the predictor and corrector are same, then we may require only one or two 
corrector iterations at each nodal point. For example, if the predictor and corrector are both of 
fourth order, then the combination (P-C method) is also of fourth order and we may require 
one or two corrector iterations at each point. If the order of the predictor is less than the order 
of the corrector, then we require more iterations of the corrector. For example, if we use a first 
order predictor and a second order corrector, then one application of the combination gives a 
result of first order. If corrector is iterated once more, then the order of the combination increases 
by one, that is the result is now of second order. If we iterate a third time, then the truncation 
error of the combination reduces, that is, we may get a better result. Further iterations may 
not change the results. 

We give below a few examples of the predictor-corrector methods. 

Example 1 

Predictor P : Euler method: 

y { n+i = yn + hf(x n ,y n )- (4.9D 

i2 

Error term = f% t ) = y% . 

Corrector C: Backward Euler method (4.84): 

y ( nh = y n + hfix n+1 , y { P\) ■ (4.92) 

Error term = - ^ /"(£ i) = - y'% i). 

Both the predictor and corrector methods are of first order. We compute 
y ( nIl=yn + hf(Xn,yJ- 

y£i=y n + hf(x n+ 1 , y®i). 

y = y n + hf(x n+1 , y^), etc. 
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Example 2 

Predictor P: Euler method: 

yj&i = y n + hf(x n , y n )■ (4.93) 

Corrector C: Trapezium method (4.85): 

y ( nh = y n + 1 lf(x n , y n ) + f(x n+lt y^\)]. (4.94) 

Error term = - -L h 3 f'% 2 ) = - ^ h 3 y"% 2 ). 

The predictor is of first order and the corrector is of second order. We compute 

ynli = y n + h f(x n ,yn)- 

y£ti = y n + \ yJ + f^ n+1 , y^)]. 

y ( nll = T're + 2 [/■(*/» y n ) + /■(*»+!> , etc. 

Example 3 Adams-Bashforth-Moulton predictor-corrector method of fourth order. 

Both the predictor and corrector methods are of fourth order. 

Predictor P : Adams-Bashforth method of fourth order. 

y\l\ =yi+dJ [55 fi - 59 fi_ t + 37 f_ 2 - 9/UJ. (4.95) 

24 

Error term = ^A 6 f (4) (^ 4 ) = ^A 5 j (5) (^ 4 ). 

The method requires the starting values y p and y i3 . 

Corrector C: Adams-Moulton method of fourth order. 

y&=yi + ^ y&) + W* - 5/u + /-_ 2 1. (4.96) 

Error term = - ^ h l Y (4) (? 4 ) = - ^ /*¥ 6) (^ 4 ). 

The method requires the starting values y t , y £1 , y t _ 2 . 

The combination requires the starting values y y i V y i2 and y i 3 . That is, we require 
the values y 0 , y v y 2 , y 3 . Initial condition gives the value y 0 . 

In the syllabus, this method is also referred to as Adams-Bashforth predictor-corrector 
method. 

Example 4 Milne’s predictor-corrector method. 

Both the predictor and corrector methods are of fourth order. 
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Predictor P : Adams-Bashforth method of fourth order. 


yl+l - yi-3 + ^ [2/i - fi-l + 2/i- 2 ] . 


(4.97) 


Error term = —h 5 f W (^)=—h 5 y i5 \^). 


The method requires the starting values y t , y i V y i2 and y i3 . 
Corrector C: Milne-Simpson’s method of fourth order. 


y\l\) + 4 f + /-,_!>]. 


(4.98) 


Error term = - -h 5 f (4 \^) = - — h 5 y (5 \^). 

90 * 90 J s 


The method requires the starting values y t , y i V 

The combination requires the starting values y ■, y i V y i2 and y i3 . That is, we require 
the values y 0 , y v y 2 , y 3 . Initial condition gives the value y 0 . 

Remark 13 Method (4.97) is obtained in the same way as we have derived the Adams-Bashforth 
methods. Integrating the given differential equation y' = fix, y) on the interval 
ix i3 , x i+1 ), we obtain 


J 1 ~ff jC dx= \ 1 fix,y)dx 



or 


Replace the integrand on the right hand side by the same backward difference polyno¬ 
mial (4.70) and derive the method in the same way as we have done in deriving the explicit 
Adams-Bashforth methods. We obtain the method as 



(4.99) 


Retaining terms up to V 3 /", we obtain the method 




= yi- 3 + ^Wi-fi-i + 2fi_ 2 ] 
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The error term is given by 

T.E .= ^AV (4) (© = ^aV 6) ®. 

45 45 

Therefore, the method is of fourth order. 

Example 4.14 Using the Adams-Bashforth predictor-corrector equations, evaluate y(1.4), if y 
satisfies 

<jy_ + y_ = J_ 

dx x x 2 

and y(l) = 1, y(l.l) = 0.996, y(1.2) = 0.986, y(1.3) = 0.972. (A. U. Nov. /Dec. 2006 ) 

Solution The Adams-Bashforth predictor-corrector method is given by 
Predictor P: Adams-Bashforth method of fourth order. 

y%l =yi + ^ [55/, - 59/U + 37 4. 2 - 9/_ 3 ]. 

The method requires the starting values y., y £1 , y j2 and y i3 . 

Corrector C: Adams-Moulton method of fourth order. 

=y^ + 24 + 19 fi - 5/j-i+ fi-2 1 

The method requires the starting values y., y^, y._ 2 . 

The combination requires the starting values y ■, y M , y._ 2 and y i3 . That is, we require 
the values y 0 , y x , y 2 , y 3 . With h = 0.1, we are given the values 

y(l) = 1, y(l.l) = 0.996, y(1.2) = 0.986, y(1.3) = 0.972. 

We have fix, y) = 

x x 

Predictor application 
For i = 3, we obtain 

yf = y[ p) =ys + ^ [55/ 3 - 59/ 2 + 37 f x - 9/ 0 ] 

We have f 0 = fix Q , y 0 ) = f[l, 1) = 1 - 1 = 0, 

A = fe v yj = A 1 - 1 ’ 0.996) = - 0.079008, 
f 2 = fix 2 , y 2 ) = fil.2, 0.986) = - 0.127222, 
f 3 = fix 3 , y 3 ) = /(1.3, 0.972) = - 0.155976. 

y ( 4 0) = 0.972 + — [55(- 0.155976) - 59(- 0.127222) + 37(- 0.079008) - 9(0)] 


= 0.955351. 
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Now, f(x 4 , y £ 0) ) = /U.4, 0.955351) = - 0.172189. 
First iteration 
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y? = yf = ys + ^ m**, y{ 0) ) + wf 3 - 5 f 2 + /i] 

= 0.972 + [9(- 0.172189) + 19(- 0.155976) - 5(- 0.127222) 

24 

+ (- 0.079008)] = 0.955516. 

Second iteration 

fix 4 , y 4 } ) = /(1.4, 0.955516) = - 0.172307. 

y ? = ys + ^ +19/3 - 5 /2 + 

= 0.972 + ^ [9(- 0.172307) + 19(- 0.155976) - 5(- 0.127222) 

24 

+ (- 0.079008)] = 0.955512. 

Now, | yf> - yf | = | 0.955512 - 0.955516 | = 0.000004. 

Therefore, y(1.4) = 0.955512. The result is correct to five decimal places. 

Example 4.15 Given y' = x 3 + y, 3 /( 0 ) = 2, the values y(0.2) = 2.073, y(0.4) = 2.452, and y(0.6) 
= 3.023 are got by Runge-Kutta method of fourth order. Findyi0.8) by Milne’s predictor-corrector 
method taking h = 0.2. {A.U. April I May 2004 ) 

Solution Milne’s predictor-corrector method is given by 

Predictor P: Adams-Bashforth method of fourth order. 

y£i=yi- 3 + ^m-fi-i + 2fi-2l 

Corrector C: Milne-Simpson’s method of fourth order. 

1 = 37-1 +1 lf(*ui> yuO + A fi + fi-ii ■ 

The method requires the starting values y p y i V y i2 and y i3 . That is, we require the 
values y 0 , y v y 2 , y 3 . Initial condition gives the value y 0 . 

We are given that 

fix, y) = x 3 + y, Xq = 0, y 0 = 2, y(0.2) =y 4 = 2.073, 
y(0.4) = y 2 = 2.452, y(0.6) = y 3 = 3.023. 



INITIAL VALUE PROBLEMS FOR ORDINARY DIFFERENTIAL EQUATIONS 


231 


Predictor application 
For i = 3, we obtain 

y ( 4 ] = y ( f = y, + ^ &f s - A + m■ 

We have f 0 = fix Q , y 0 ) = ft 0, 2) = 2, 

A = ftx v y$ = ft.0.2, 2.073) = 2.081, 

A = ftx 2 , y 2 ) = fiOA, 2.452) = 2.516, 

A = /tx 3 , 3 / 3 ) = /10.6, 3.023) = 3.239. 

yT = 2 + [2(3.239) - 2.516 + 2(2.081)] = 4.1664. 

Corrector application 

First iteration For i = 3, we get 

y ( 4 ) =y2 + ^[f(x 4 y 4 0) ) + 4f 3+ f 2 ] 

Now, f(x 4 , yf) = ft0.8, 4.1664) = 4.6784. 

= 2.452 + ^ [4.6784 + 4(3.239) + 2.516] = 3.79536. 

Second iteration 

y? =y2 + ™m*i,y?) + ±h+f2\ 

Now, fix 4 , y^) = fi0.8, 4.6784) = 4.30736. 

yf ] = 2.452 + ^ [4.30736 + 4(3.239) + 2.516] = 3.770624. 

We have | y f> - y™ \ = | 3.770624 - 3.79536 | = 0.024736. 

The result is accurate to one decimal place. 

Third iteration 

3'i 3) =J2+^[/’U4,jf) + 4A+/ 2 ] 

Now, fix 4 , yf } ) =fi0.8, 3.770624) = 4.282624. 

yi 3) =2.452 + ^ [4.282624 + 4(3.239) + 2.516] = 3.768975. 

We have | yf - y f> \ = | 3.768975 - 3.770624 | = 0.001649. 

The result is accurate to two decimal places. 
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Fourth iteration 

y? ) = y2 + ™lf(xA,y? ) ) + *f 3 +f2] 

Now, fix 4 , yf) = fi 0.8, 3.76897) = 4.280975. 

yf = 2.452 + ^ [4.280975 + 4(3.239) + 2.516] = 3.768865. 

We have | y' 4) - yf \ = | 3.768865 - 3.768975 | = 0.000100. 

The result is accurate to three decimal places. 

The required result can be taken as y(0.8) = 3.7689. 

Example 4.16 Using Milne’s predictor-corrector method, findy(0.4)for the initial value problem 
y'= x 2 + y 2 , y( 0) = 1, with h = 0.1. 

Calculate all the required initial values by Euler’s method. The result is to be accurate to three 
decimal places. 

Solution Milne’s predictor-corrector method is given by 

Predictor P: Adams-Bashforth method of fourth order. 

y \+[ = yi-3 + [2/i - fi~i + 2 /’j_ 2 ]. 

Corrector C: Milne-Simpson’s method of fourth order. 

= y<-i + 1 W*M,y&) + *fi + fi-J ■ 

The method requires the starting values y t , y i v y i 2 and y i 3 . That is, we require the 
values y 0 , y v y 2 , y 3 . Initial condition gives the value y 0 . 

We are given that 

fix, y) = x 2 + y 2 , x 0 = 0,y 0 = 1. 

Euler’s method gives 

y i+ 1 = y t + hf(x t , y t ) = y t + 0.1(xf + yf). 

With x 0 = 0, y 0 = 1, we get 

3b =y 0 + o.l (X$ + yl) = 1.0 + 0.1 (0 + 1.0) = 1.1. 

y 2 = y ± + 0.1 ( x f + yf) = 1.1 + 0.1 (0.01 + 1.21) = 1.222. 

y 3 = y 2 + 0.1 (xf + yl) = 1-222 + 0.1[0.04 + (1.222) 2 ] = 1.375328. 
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Predictor application 
For i = 3, we obtain 

yf=y[ p) =y, + ^-Vh-f 2 +m\ 

We have f x = fix v yj = f{ 0.1, 1.1) = 1.22, 

f 2 = fix 2 , y 2 ) = f{ 0.1, 1.222) = 1.533284, 
f 3 = fi.x 3 , y 3 ) = f{ 0.3, 1.375328) = 1.981527. 

yf = L°+ [2(1.981527) - 1.533284 + 2(1.22)] = 1.649303. 

Corrector application 

First iteration For i = 3, we get 

y ( 4 ) =y2 + Y [f< ‘ x *’ y * )) + 4f3+ f* ] 

Now, f(x 4 , yf) = fiOA, 1.649303) = 2.880200. 

yf = 1-222 + S [2.880200 + 4(1.981527) + 1.533284] = 1.633320. 
Second iteration 

3'4 2) =3'2 + y [ ^4.3'4 1) ) + 4/ 3 +/- 2 ] 

Now, f(x 4 , yf) = /(0.4, 1.633320) = 2.827734. 

yf = L222 + ^ [2.827734 + 4(1.981527) + 1.533284] = 1.631571. 

We have | yf - yf \ = | 1.631571 - 1.633320 | = 0.001749. 

The result is accurate to two decimal places. 

Third iteration 

3'4 3) =3'2+Y[/ , (x 4> 3'i 2) ) + 4/- 3+ /- 2 ] 

Now, f{x 4 ,yf) = /(0.4, 1.631571) = 2.822024. 

yf = 1.222 + ^ [2.822024 + 4(1.981527) + 1.533284] = 1.631381. 

We have | yf - yf \ = | 1.631381- 1.631571 | = 0.00019. 

The result is accurate to three decimal places. 

The required result can be taken as y(0.4) ~ 1.63138. 
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- ( REVIEW QUESTIONS ) - 

1. Are the multi step methods self starting ? 

Solution Multi step methods are not self starting, since a &-step multi step method 
requires the k previous values y p y i V ..., y. kl l . The k values that are required for start¬ 
ing the application of the method are obtained using some single step method like Euler 
method, Taylor series method or Runge-Kutta method, which is of the same or lower 
order than the order of the multi step method. 

2. Why do we require predictor-corrector methods for solving the initial value problem 
y' = fix, y), y(x 0 ) = y 0 ? 

Solution If we perform analysis for numerical stability of single or multi step methods, 
we find that all explicit methods require very small step lengths to be used for conver¬ 
gence. If the solution of the problem is required over a large interval, we may need to 
use the method, thousands or even millions of steps, which is computationally very 
expensive. Most implicit methods have strong stability properties, that is, we can use 
sufficiently large step lengths for computations and we can obtain convergence. How¬ 
ever, we need to solve a nonlinear algebraic equation for the solution at each nodal 
point. This procedure may also be computationally expensive as convergence is to be 
obtained for the solution of the nonlinear equation at each nodal point. Therefore, we 
combine the explicit methods (which have weak stability properties) and implicit meth¬ 
ods (which have strong stability properties) to obtain new methods. Such methods are 
called predictor-corrector methods. 

3. What are predictor-corrector methods for solving the initial value problem 
y' = fix, y), y(x 0 ) = y 0 ? Comment on the order of the methods used as predictors and 
correctors. 

Solution We combine the explicit methods (which have weak stability properties) and 
implicit methods (which have strong stability properties) to obtain new methods. Such 
methods are called predictor-corrector methods. We denote P for predictor and C for 
corrector. 

P: Predict an approximation to the solution y i+1 at the current point, using an explicit 
method. Denote this approximation as y[f\. 

C: Correct the approximation y^\, using a corrector, that is, an implicit method. Denote 
this corrected value as The corrector is used 1 or 2 or 3 times, depending on the 
orders of explicit and implicit methods used. 

The order of the predictor should be less than or equal to the order of the corrector. If 
the orders of the predictor and corrector are same, then we may require only one or two 
corrector iterations at each nodal point. For example, if the predictor and corrector are 
both of fourth order, then the combination iP-C method) is also of fourth order and we 
may require one or two corrector iterations at each point. If the order of the predictor is 
less than the order of the corrector, then we require more iterations of the corrector. For 
example, if we use a first order predictor and a second order corrector, then one 
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application of the combination gives a result of first order. If corrector is iterated once 
more, then the order of the combination increases by one, that is, the result is now of 
second order. If we iterate a third time, then the truncation error of the combination 
reduces, that is, we may get a better result. Further iterations may not change the 
results. 

4. Write Adams-Bashforth predictor-corrector method for solving the initial value problem 
y' = fix, y), y(x 0 ) = b 0 . Comment on the order and the required starting values. 
Solution The Adams-Bashforth predictor-corrector method is given by 

Predictor P: Adams-Bashforth method of fourth order. 

+ 2 * m, - + 37fi_ 2 - 9/;j. 

Error term = *Y <4> 8L> = f|j *V®&>. 

The method requires the starting values y t , y i v y i2 and y i3 . 

Corrector C: Adams-Moulton method of fourth order. 

ylft=y> + 2 4 i9f(x ^’ y$> + 19f ' ~ + f ^ ] ■ 

Error term = - ^h 5 f w . 

The method requires the starting values y v y i V y i2 . 

The combination requires the starting values y ■, y iV y i 2 and y i3 . That is, we require 
the values y 0 , y v y 2 , y 3 . Initial condition gives the value y 0 . 

5. Write the Milne’s predictor-corrector method for solving the initial value problem 
y' = fix, y), yix 0 ) = b Q . Comment on the order and the required starting values. 
Solution Milne’s predictor-corrector method is given by 

Predictor P: Adams-Bashforth method of fourth order 

y^hyi-s+Y l2fi ~ fi - 1+2fi - 2h 

Error term = — h 5 f w (E) = — &V 5) (E). 

45 45 

The method requires the starting values y t , y-_ x , y t _ 2 and y t _ 3 . 

Corrector C: Milne-Simpson’s method of fourth order 

y% =yt-i + |[Ax <+ i,y^i ) )+¥ i +/U1 

Error term = - ^ h 5 f w ® = -^- h 5 y (5) U~). 

The method requires the starting values y v y i V 
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The combination requires the starting values y ■, y i V y i2 and y. 3 . That is, we require 
the values y 0 , y v y 2 , y 3 . Initial condition gives the value y 0 . 

6 . How many prior values are required to predict the next value in Adams-Bashforth- 
Moulton method ? 

Solution The Adams-Bashforth-Moulton predictor-corrector method requires four 
starting values y p y i V y i 2 and y i 3 . That is, we require the values y 0 , y v y 2 , y 3 . Initial 
condition gives the value y 0 . 

7. How many prior values are required to predict the next value in Milne’s predictor- 
corrector method ? 

Solution The Milne’s predictor-corrector method requires four starting values y t , y i V 
y i 2 and y i 3 . That is, we require the values y 0 , y v y 2 , y 3 . Initial condition gives the value 
*0- 

8. What are the orders of the predictor and corrector in Adams-Bashforth-Moulton predic¬ 
tor-corrector method ? 

Solution Both the predictor and corrector are of fourth order, that is, truncation error 
is of order 0(h 5 ) in each case. 

9. What are the orders of the predictor and corrector in Milne’s predictor-corrector method ? 
Solution Both the predictor and corrector are of fourth order, that is, truncation error 
is of order Oih 5 ) in each case. 

- ( EXERCISE 4.4 ) - 

1. Using the Runge-Kutta method of order 4, find y for x = 0.1, 0.2, 0.3 given that 

-j- = xy + y 2 , y(0) = 1 
dx 

and also find the solution at x = 0.4 by Milne’s method. ( A.U. Nov. /Dec. 2003) 

2. Use Milne’s method to find y(4.4) given that 

5 xy' + y 2 - 2 = 0, y(4) = 1, y(4.1) = 1.0049, y(4.2) = 1.0097, y(4.3) = 1.0143. 

(At/. Nov. /Dec. 2004) 

3. The differential equation y' - y — x 2 , is satisfied by y(0) = 1, y(0.2) = 1.12186, y(0.4) 

= 1.46820, y(0.6) = 1.7359. Compute the value of y(0.8) by Milne’s predictor-corrector 
formula. (A. U. Nov. /Dec. 2006) 

4. Solve y' = x - y 2 , 0 < * < 1, y(0) = 0, y(0.2) = 0.02, y(0.4) = 0.0795, y(0.6) = 0.1762 by 

Milne’s method to find y(0.8) and y(l). (A. U. April/May 2005) 

5. Determine the value ofy(0.4) using Milne’s method given that y' = xy + y 2 , y(0) = 1. Use 
Taylor series method to get the values of y(0.1), y(0.2) and y(0.3). 

(At/. Nov. /Dec. 2003) 

6. Given that y' + xy + y = 0, y(0) = 1, obtain y for x = 0.1, 0.2, and 0.3 by Taylor series 
method and find the solution for y(0.4) by Milne’s method. (A.t/. Nov. /Dec. 2003) 
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7. Compute the first 3 steps of the initial value problem y' = ( x -y)/2, y(0) = 1.0 by Taylor 
series method and next step by Milne’s method with step length h = 0.1. 

(A.U. Nov. I Dec. 2005) 

8. Solve the initial value problem 

/ = (1 + x 2 )(y - 1), y(l) = 0, xe [1.0, 1.4] 
with h = 0.1 using the Milne’s predictor corrector method. Perform two iterations of the 
corrector. Compute the starting values using the Euler method with the same step size. 

9. Solve the initial value problem 

y'=y-x 2 , y(0) = 1, x e [0.0, 0.4] 

with h = 0.1 using the Adams-Bashforth predictor-corrector method. Perform two 
iterations of the corrector. Compute the starting values using the Taylor series method 
of the same order. Also, compare these solutions with the exact solution y(x) = x 2 + 2x 
+ 2-e x . 

10. Consider the initial value problem 

dy o 

= y - x 2 + 1 , ^(O) = 0.5 (A. U. April /May 2003 ) 

Using the Adams-Bashforth predictor-corrector method, find f[ 0.8). 

11. Given — = x 2 (1+y), y(l) = l,y(Ll) = L233, y(L2) = L548, y(L3) = L979, 

dx 

evaluate y(1.4) by Adams-Bashforth method. ( A.U. Nov. /Dec. 2004) 

12 . Solve y' = 1 - y with the initial condition x = 0, y = 0, using Euler’s algorithm and 

tabulate the solutions at x = 0.1, 0.2, 0.3, 0.4. Using these results find y(0.5), using 
Adams-Bashforth predictor-corrector method. (A.U. May/June 2006 ) 


4.7 STABILITY OF NUMERICAL METHODS 

In any initial value problem, we require solution for x > x 0 and usually up to a point x = b. The 
step length h for application of any numerical method for the initial value problem must be 
properly chosen. The computations contain mainly two types of errors: truncation error and 
round-off error. Truncation error is in the hand of the user. It can be controlled by choosing 
higher order methods. Round-off errors are not in the hands of the user. They can grow and 
finally destroy the true solution. In such case, we say that the method is numerically unstable. 
This happens when the step length is chosen larger than the allowed limiting value. All explicit 
methods have restrictions on the step length that can be used. Many implicit methods have no 
restriction on the step length that can be used. Such methods are called unconditionally stable 
methods. 

The behaviour of the solution of the given initial value problem is studied by consider¬ 
ing the linearized form of the differential equation y' = f (x, y). The linearized form of the 
initial value problem is given by y' = hy, A, < 0, y(x Q ) = y Q . The single step methods are applied 
to this differential equation to obtain the difference equation y i+1 = EQJi/y^ where E(Xh) is 
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called the amplification factor. If | EQJi) \ < 1, then all the errors (round-off and other errors) 
decay and the method gives convergent solutions. We say that the method is stable. This 
condition gives a bound on the step length h that can be used in the computations. We have 
the following conditions for stability of the single step methods that are considered in the 
previous sections. 

1. Euler method: - 2 < Xh < 0. 

2. Runge-Kutta method of second order: - 2 < Xh < 0. 

3. Classical Runge-Kutta method of fourth order: - 2.78 < Xh < 0. 

4. Backward Euler method: Stable for all h, that is, - °° < Xh < 0. (Unconditionally 
stable method). 

Similar stability analysis can be done for the multi step methods. We have the follow¬ 
ing stability intervals (condition on X h), for the multi step methods that are considered in the 
previous sections. 


Order 

Adams-Bashforth methods 

Adams-Moulton methods 

1 

(- 2, 0) 

(-~, 0) 

2 

(- 1 , 0) 

(-<*>, 0) 

3 

(- 0.5, 0) 

(- 6, 0) 

4 

(- 0.3, 0) 

(- 3, 0) 


Thus, we conclude that a numerical method can not be applied as we like to a given 
initial value problem. The choice of the step length is very important and it is governed by the 
stability condition. 

For example, if we are solving the initial value problem y' = — lOOy, y(x 0 ) = y 0 , by Euler 
method, then the step length should satisfy the condition — 2 < Xh < 0 or — 2 < — 100A < 0, or 
h < 0.02. 

The predictor-corrector methods also have such strong stability conditions. 


4.8 ANSWERS AND HINTS 


Exercise 4.1 

1. 0.1, 0.22; 0.11, 0.24205; 0.11, 0.24205. 

2. 0.9, 0.819; 0.90975, 0.834344; 0.9095, 0.833962. 

3. h = 0.1: 1.573481; h = 0.2: 1.496. Extrapolated value = 2(1.573481) - 1.496 =1.650962. 

4. h = 0.1: 3.848948; h = 0.2: 3.137805. Extrapolated value = 2(3.848948) - 3.137805 
= 4.560091. 

5. | Error | < (A 2 /2) ^max ^| y"{x) \ = (A 2 /2) ^max J 1-siny |<A 2 . For A = 0.2, | Error | < 
0.05. 

6 . yi = 1.252533, y 2 = 1.693175. 
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7. Taylor series method: 1.355, 1.855475, 2.551614, 3.510921. Heun’s method: 1.355, 
1.855475, 2.551614, 3.510921. 

8. Use Taylor series method of fourth order 1.508933, 2.305006. 

9. Use Taylor series method of fourth order 1.46555, 2.128321. 

In Problems 10-13, use Taylor series method of fourth order. 

10. 0.900308. 11. 0.110342. 12. 1.110342, 1.242806. 

13. 1 + h + h 2 + (h 3 / 3) + 12) 14. 1.1105. 15. 0.66475. 

Exercise 4.2 

1. h = 0.2. 1.214076, 1.648922. 2. 1.196 

3. h = 0.1: 1.116492, 1.273563. 4.y(0.2) * 1.866204, y(0.4) = 3.07267 

5. y(0.1) = 1.111463, y(0.2) = 1.253015. 

6. y(0.2) * 1.2428, y(0.4) = 1.583636. 

7. y(0.2) = 1.821846, y(0.4) - 3.325775. 

8. y(0.1) = 1.099383, y(0.2) = 1.195440. 

Exercise 4.3 

1. Set u = y. u' = v, v' = e 2t -2 u - 3v, u{ 0) = 1, o(0) = 1. 

2. Set u-y.u'- v, v' = sin 2t - 5u + 6v, u( 0) = 0, o(0) = 1. 

3. Set u = y. u' = v, v' = te l - u - 2v, u( 0) = 0.5, v(0) = 0.8. 

In Problems 4—7, use Taylor series method of fourth order. 

4. Set u =y. u' = v, v' = e 2t sin t-2u + 2v, u( 0) = - 0.4, v(0) = - 0.6, y(0.1) » - 0.461735. 

5. Set u = y. u' = v, v' = e* - 2u - 3v, u( 0) = 1, o(0) = 1, y(0.2) = 1.133067. 

6 . Set u = y. u' = v, v' = e 2t -4 u + 4v, u( 0) = 0.5, v(0) = 1, y(0.2) = 0.775727. 

7. Set u =y. u' = v, v' = e l - 5u + 6v, u( 0) = 0, u(0) = - 1, y(0.1) « - 0.129492. 

8. Set u =y. u' = v, v' = e 2t sin t - 2u + 2v, u( 0) = - 0.4, u(0) = - 0.6, y(0.2) ~ - 0.525572. 

9. Set u=y.u' = v,v'= -u- v, u( 0) = 1, v(0) = 0,y(0.1) = 0.995167. 

10. Set u=y.u' = v,v' = e t -2u- 3v, u( 0) = 1, v(0) = 1, y(0.2) = 1.133187. 

11. Set u = y. u' = v, v' = te { - u - 2v, u( 0) = 0.5, v(0) = 0.8, y(0.2) = 0.623546. 

12. Set u = y. u' = v, v' = - u - xv, u(0) = 1, v(0) = 0, k 1 = 0.0, l x = - h. 

Exercise 4.4 

In the following problems, two iterations of the corrector in Milne’s method were performed. 
Taylor series method of fourth order was used. Two iterations of the corrector in Adams- 
Bashforth predictor-corrector method were performed. 

1. y(0.1) = 1.116887, y(0.2) = 1.277391, y(0.3) = 1.504187. y(0.4) = 1.839364. 

2. y(4.4) = 1.018737. 3.y(0.8) = 2.013683. 

4. y(0.8) = 0.304614, y(1.0) = 0.455551. 




240 


NUMERICAL METHODS 


5 . y(0.1) = 1.116838, y(0.2) = 1.277276, y(0.3) = 1.503843, y(0.4) = 1.839043. 

6. y(0.1) = 0.900325, y(0.2) = 0.802520, y(0.3) = 0.708222, y(0.4) = 0.618784. 

7 . y(0.1) = 0.953688, y(0.2) = 0.914512, y(0.3) = 0.882124, y(0.4) = 0.856192. 

8. y(l.l) = - 0.2, y( 1.2) = - 0.4652, y(1.3) = - 0.822709, y( 1.4) = - 1.483650. 

9 . y(O.l) = 1.104829, y(0.2) - 1.218596, y(0.3) = 1.34039, y(0.4) = 1.468174. 

10 . y(0.2) = 0.8293, y(0.4) = 1.214091, y(0.6) = 1.648947, y(0.8) = 2.127230. 

11 . y(1.4) = 2.575142. 

12. y(O.l) = 0.1, y(0.2) = 0.19, y(0.3) = 0.271, y(0.4) = 0.3439. y(0.5) = 0.406293. 
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Boundary Value Problems in Ordinary 
Differential Equations and Initial and 
Boundary Value Problems in Partial 
Differential Equations 


5.1 INTRODUCTION 

Boundary value problems are of great importance in science and engineering. In this chapter, 
we shall discuss the numerical solution of the following problems: 

(а) Boundary value problems in ordinary differential equations. 

(б) Boundary value problems governed by linear second order partial differential equa¬ 
tions. We shall discuss the solution of the Laplace equation u xx + u yy = 0 and the 
Poisson equation u xx + u yy = G(x, y). 

(c) Initial boundary value problems governed by linear second order partial differential 
equations. We shall discuss the solution of the heat equation u t = c 2 u xx and the wave 
equation u tt = c 2 u xx under the given initial and boundary conditions. 


5.2 BOUNDARY VALUE PROBLEMS GOVERNED BY SECOND ORDER ORDINARY 
DIFFERENTIAL EQUATIONS 

A general second order ordinary differential equation is given by 

y" - fix, y, /), x e [a, b]. (5.1) 

Since the ordinary differential equation is of second order, we need to prescribe two 
suitable conditions to obtain a unique solution of the problem. If the conditions are prescribed 
at the end points x = a and x = b, then it is called a two-point boundary value problem. For our 
discussion in this chapter, we shall consider only the linear second order ordinary differential 
equation 

a 0 (x) y" + a^x) y' + a 2 {x) y = d(x), x e [a, b] (5.2) 

or, in the form 
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y" + p(x) y' + q(x) y = r(x), x e [a, b ]. (5.3) 

We shall assume that the solution of Eq.(5.3) exists and is unique. This implies that 
a 0 (x), a 1 (x), a 2 (x) and d(x), or p(x), q(x) and r{x) are continuous for all x e [a, b]. 

The two conditions required to solve Eq.(5.2) or Eq.(5.3), can be prescribed in the follow¬ 
ing three ways: 

(i) Boundary conditions of first kind The dependent variable y(x) is prescribed at the 
end points x = a and x = b. 

y(a) = A, y(b) = B. (5.4) 

(ii) Boundary conditions of second kind The normal derivative of y(x), (slope of the 
solution curve) is prescribed at the end points x = a and x = b. 

y'(a) = A, y'(b) = B. (5.5) 

(iii) Boundary conditions of third kind or mixed boundary conditions 

a 0 y(a) - a^'ia) =A, 

b ( y(b) + b 1 yXb) = B, (5.6) 

where a 0 , a v b 0 , b v A and B are constants such that 

a ( p 1 > 0, | a 0 | + | a 1 | * 0, b 0 b 1 > 0, | b 0 \ + \ b 1 \ * 0, | a 0 | + | 5 0 | ^ 0. 

We shall consider the solution of Eq.(5.2) or Eq.(5.3) under the boundary conditions of 
first kind only, that is, we shall consider the solution of the boundary value problem 

y" + pix) y' + q(x) y = r(x), x e [a, b] 

y(a) = A, y(b) = B. (5.7) 

Finite difference method Subdivide the interval [a, b] into n equal sub-intervals. The length 
of the sub-interval is called the step length. We denote the step length by Ax or h. Therefore, 

A x = h = b or b = a + nh. 

n 

The points a = x 0 , x 1 = x 0 + h, x 2 = x Q + 2 h, . x t = x 0 + ih, , x n = x 0 + nh = b, are called 

the nodes or nodal points or lattice points (Fig. 5.1). 

h h h 

a = x 0 x, x 2 x M x ; x i+1 x n =b 

Fig. 5.1 Nodes. 

We denote the numerical solution at any point x { by y ■ and the exact solution by y(xf. 

In Chapter 3, we have derived the following approximations to the derivatives. 
Approximation to y'ixf at the point x = x ■ 

(i) Forward difference approximation of first order or 0(h) approximation: 

y'ix) = ^ (y^j) -y(xp], or y\ = ^ \y i+ 1 -y^- 


(5.8) 
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{ii) Backward difference approximation of first order or 0(h) approximation: 



(5.9) 


(iii) Central difference approximation of second order or 0(h 2 ) approximation: 



(5.10) 


Approximation to y"{x) at the point x = x t 

Central difference approximation of second order or 0(h 2 ) approximation: 


y"{x t ) ~ [y(x. +1 ) - 2y(x i ) + yix^], 

h 


or 



(5.11) 


Applying the differential equation (5.3) at the nodal point x = x t , we obtain 
y'\xi) + pixjy'ix;) + qixjyix;) = r(x.). 


(5.12) 


Since y(a) = y(x 0 ) = A and y(b) = y(x n ) = B are prescribed, we need to determine the 
numerical solutions at the n - 1 nodal points x v x 2 , ..., x-, ...., x n l . 

NoWjy'Crp is approximated by one of the approximations given in Eqs. (5.8), (5.9), (5.10) 
and y'XxJ is approximated by the approximation given in Eq.(5.11). Since the approximations 
(5.10) and (5.11) are both of second order, the approximation to the differential equation is of 
second order. However, if y\xi) is approximated by (5.8) or (5.9), which are of first order, then 
the approximation to the differential equation is only of first order. But, in many practical 
problems, particularly in Fluid Mechanics, approximations (5.8), (5.9) give better results (non- 
oscillatory solutions) than the central difference approximation (5.10). 

Using the approximations (5.10) and (5.11) in Eq.(5.12), we obtain 


~2 ty; + i - 2 y t + y,,1 + \y i+1 - wj + q(xi) y t = r . 

h 2 h 

2 [y i+1 - 2y . + y J + h p(x [y i+1 - + 2 h 2 q(x t ) y t = 2 h 2 r t . 


or 


Collecting the coefficients, we can write the equation as 
+ i = 1, 2, ..., n - 1 


(5.13) 


where a t = 2-h p(x t ), 6- = - 4 + 2 h 2 qixi), c f = 2 + h p(xi), d t = 2 h 2 r(xi). 

Let us now apply the method at the nodal points. We have the following equations. 
At x = x 1 , or i = 1: 


+ + c i3 ; 2 = d v or + c i3 ; 2 = d i ~ a \ A = d l- 


(5.14) 


At x =x t , i = 2, 3, ..., n -2 : 
a-y^i + b i y i + c i y i+1 = d i 


(5.15) 
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At x = x n V or i = n - 1: 

a n- 13'„_2 + b n-iy n -l + C n-\y n = d n-V 0r °n-l^n-2 + b n-^n-\ = rf n-l ~ C n-1' B = d n- 1' (5.16) 

Eqs.(5.14), (5.15), (5.16) give rise to a system of (n - 1) x (n - 1) equations Ay = d for the 
unknowns y v y 2 , ..., y., ..., y n _ v where A is the coefficient matrix and 

y = b' 1 ,y 2 > •••> y» -.y„_ d T , d = [d{, d 2 . d t ,..., d n _ 2 , d*_ 1 ] T . 

It is interesting to study the structure of the coefficient matrix A. Consider the case 
when the interval [a, b ] is subdivided into n = 10 parts. Then, we have 9 unknowns, y v y 2 , ...., 
y 9 , and the coefficient matrix A is as given below. 

Remark 1 Do you recognize the structure of A? It is a tri-diagonal system of algebraic equations. 
Therefore, the numerical solution of Eq.(5.2) or Eq.(5.3) by finite differences gives rise to a 
tri-diagonal system of algebraic equations, whose solution can be obtained by using the Gauss 
elimination method or the Thomas algorithm. Tri-diagonal system of algebraic equations is 
the easiest to solve. In fact, even if the system is very large, its solution can be obtained in a 
few minutes on a modern desk top PC. 



Ci 

0 

0 

0 

0 

0 

0 

0 ' 

a 2 

b 2 

c 2 

0 

0 

0 

0 

0 

0 

0 

a 3 

bs 

c 3 

0 

0 

0 

0 

0 

0 

0 

a 4 

b 4 

c 4 

0 

0 

0 

0 

0 

0 

0 

a 5 

b 5 

c 5 

0 

0 

0 

0 

0 

0 

0 

a 6 

b 6 

c 6 

0 

0 

0 

0 

0 

0 

0 

a 7 

b 7 

c 7 

0 

0 

0 

0 

0 

0 

0 

a 8 

be 

c 8 

0 

0 

0 

0 

0 

0 

0 

b d 

C 9_ 


Remark 2 Does the system of equations (5.13) always converge ? We have the following sufficient 
condition: If the system of equations (5.13) is diagonally dominant, then it always converges. 
Using the expressions for a-, b t , c-, we can try to find the bound for h for which this condition is 
satisfied. 

Example 5.1 Derive the difference equations for the solution of the boundary value problem 
y" + p(x) y' + q(x) y = rix), x e [a, b] 
y{a) = A, y{b) = B 

using central difference approximation for y" and forward difference approximation for y'. 
Solution Using the approximations 

y"= 7T to+i “ 2 yi + Vi-y'i = 1 to+i - yd 

h h 

in the differential equation, we obtain 

^2 bi+ 1 - 2 y t + y t - il + [y l+l -yj + q(x l )y l = r( Xi ) 
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or [y i+ i - 2 \y i + y i J + h p(x .) [y i+1 - y t i + h 2 q(xf) y t = h 2 r i 

or y j_! + b iyi + Ci y i+1 = d i , i = 1,2, 1 

where b i = -2 - h p{xf) + h 2 q(xf, c t = 1 + h p(x), d i = h 2 r i . 

The system again produces a tri-diagonal system of equations. 

Example 5.2 Derive the difference equations for the solution of the boundary value problem 
y" + p(x) y' + qix) y = r{x), x e [a, b] 
y{a) = A, y(b) = B 

using central difference approximation for y" and backward difference approximation for y'. 
Solution Using the approximations 

y"= ~2 b'i+i - 2 + y t - il, y'i = \ [y t - y^J 

h h 

in the differential equation, we obtain 

-y [y i+ 1 - 2 y t + y^J + - [y* - y^-J + ql^ly* = r(xf) 

h h 

or [y i+1 - 2y. + y- J + h p{xi) \y t - y t J + h 2 q(x i )y i = h 2 r i 

or a i y il +b i y i +y i + 1 = d t , i = 1,2.n-1 

where a t = 1- h p{xf), b ■ m - 2 + h p(x t ) + h 2 q{xf), d t = h 2 r i . 

The system again produces a tri-diagonal system of equations. 

Example 5.3 Solve the boundary value problem xy"+y = 0, y(l) = 1, y(2) = 2 by second order 
finite difference method with h = 0.25. 

b-a 2-1 

Solution We have h = 0.25 and n = —-— = ——— = 4. 

h 0.25 

We have five nodal points x 0 = 1.0, x 4 = 1.25, x 2 = 1.5, x 3 = 1.75, x 4 = 2.0. 

We are given the data values y(x 0 ) = y 0 = y(l) = 1, y(x 4 ) = y 4 = y(2) = 2. 

We are to determine the approximations for y(1.25), y(1.5), y(1.75). Using the central 
difference approximation for y", we get 

-p- bi+i - 2y^ + y^jJ + y t = 0, or 16x^ y H + (1 - 32x f ) y. + 16x- y i+1 = 0. 

We have the following difference equations. 

For i = l,x 1 = 1.25, y 0 = 1.0 : 20y 0 - 39y 4 + 20y 2 = 0 or - 39y x + 20y 2 = - 20 

For i = 2, x 2 = 1.5 : 24y 1 - 47y 2 + 24y 3 = 0. 

For i = 3, x 3 = 1.75, y 4 = 2.0 : 28y 2 - 55y 3 + 28y 4 = 0 or 28y 2 - 55y 3 = - 56. 
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We have the following system of equations 


39 

24 

20 

-47 

O' 

24 

3b 

3b 

j 

'-20' 

0 

0 

28 

-55 

3b 


-56 


We can solve this system using Gauss elimination. We obtain 


'- 39 

20 

0 I - 20' 

7? 

' 1 

-20/39 

0 

I 20 / 39' 

24 

-47 

24 0 

n 1 

’-39’ 

24 

-47 

24 

0 

0 

28 

- 55 - 56 

0 

28 

-55 

-56 


1 -20/39 

0 

20 / 39 ' 

R 

'1 -20/39 

0 

20/39 ' 

0 -1353/39 

24 

- 480/39 


0 1 

- 936/1353 

480/1353 

0 28 

-55 

-56 

’ (-1353/39) ’ 

0 28 

-55 

-56 


1 - 

20/39 

0 I 

20/39 



R 3 - 28 R 2 , 

0 

1 

936/1353 

480/1353 




0 

0 - 48207/1353 | - 89208/1353 




From the last equation, we get y, = -= 1.85052. 

3 48207 

480 936 

Back substitution gives y 9 = (1.85052) = 1.63495, 

1353 1353 

20 

3/1 = 39 (1 + L63495) = L35126 - 

Example 5.4 Using the second order finite difference method, find y(0.25), y(0.5), y(0.75) sat¬ 
isfying the differential equation y" - y = x and subject to the conditions y(0) = 0, y(l) = 2. 

Solution We have h = 0.25 and n = , = \ ^ = 4. 

h 0.25 

We have five nodal points x 0 = 0.0, x 1 = 0.25, x 2 = 0.5, x 3 = 0.75, x 4 = 1.0. 

We are given the data values y(x 0 ) = y 0 = y(0) = 0, y(x 4 ) =y 4 = y(l) = 2. 

We are to determine the approximations for y(0.25), y(0.5), y(0.75). Using the central 
difference approximation for y", we get 

-y [ 37+1 - 2 y t + y t _ 1 ] - y t = x t , or 16y ■_ 1 - 33y ■ + 16y- +1 = x.. 

We have the following difference equations. 

For i = l,x 1 = 0.25, y 0 = 0.0 : 16y 0 - 33 y 1 + 16y 2 = 0.25 or - 33 y 4 + 16y 2 = 0.25, 

For i = 2, x 2 = 0.5 : 163 /j^ - 33 y 2 + 16y 3 = 0.5, 

For i = 3, x 3 = 0.75, y 4 = 2.0 : 16y 2 - 33y 3 + 16y 4 = 0.75 or 16y 2 - 33y 3 = - 31.25. 
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We have the following system of equations 


33 

16 

16 

-33 

O' 

16 

3b 

3b 

= 

0.25' 

0.5 

0 

16 

-33 

3^3 


-3L25 


We can solve this system using Gauss elimination. We obtain 



33 

16 

0 I 

°- 25 l R 


' 1 - 0.48485 

0 I - 0.007576] 



16 

-33 

16 

0.5 , —I— 


16 -33 


16 0.5 , R 2 

- 16i? 1 , 


0 

16 - 

■33 - 

3L25J 

0 16 


- 33 - 56 J 


'1 

_ 

0.48485 

0 

- 0.007576' 


r 2 

A 

- 0.48485 0 

- 0.007576] 

0 

- 

25.2424 

16 

0.621216 


0 

1 - 0.63385 

-0.02461 L 

0 


16 

-33 

- 3L25 


0 

16 - 33 

-3L25 J 


1 

- 0.48485 

0 

I - 0.007576' 

0 

1 

- 0.63385 

-0.02461 

0 

0 

- 22.8584 | - 30.85624 


, , 30.85624 

From the last equation, we get y 3 = 22 8584 = 1-34989. 

Back substitution gives 

y 2 = - 0.02461 + 0.63385(1.34989) = 0.83102, 

y x = - 0.007576 + 0.48485(0.83102) = 0.39534. 

Example 5.5 Solve the boundary value problem y" + 5 y'+ 4y = 1, y(0) = 0, y(l) = 0 by finite 
difference method. Use central difference approximations with h = 0.25. If the exact solution is 


y(x) = Ae~ x + Be -4 * + 0.25, where A = 


4(1 -e“ d ) 

find the magnitude of the error and percentage relative error at x = 0.5. 


, B = - 0.25 - A 


h 0.25 ' 

We have five nodal points x 0 = 0.0, x 1 = 0.25, x 2 = 0.5, x 3 = 0.75, x 4 = 1.0. 

We are given the data values yCr 0 ) = y 0 = y(0) = 0, y(xf) = y 4 = y(l) = 0. 

We are to determine the approximations for y(0.25), y(0.5), y(0.75). Using the central 
difference approximations, we get 

^2 fo+i - 2 yi + yi -^ (o'i+i - yi-d + 4 y. = 1, 
or - 2y. + y t _f\ + 10 (y i+1 + 4y. = 1, or 6y i :l - 28y- + 26 y M = 1. 
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We have the following difference equations. 

For i = 1, x 1 = 0.25, y 0 = 0.0 : 6y 0 - 28 y 1 + 2&y 2 = 1 or - 28 y 1 + 26 y 2 = 1. 

For i = 2, x 2 = 0.5 : 6 y x - 28 y 2 + 26y 3 = 1. 

For i = 3, x 3 = 0.75, y 4 = 0 : 6y 2 - 28 y 3 + 26y 4 =1 or 6y 2 - 28y 3 = 1. 

We have the following system of equations 


f- 28 

6 

26 

-28 

°1 

26 

Vx 

y% 



L o 

6 

-28j 

y* 


LiJ 


We can solve this system using Gauss elimination. We obtain 


28 

26 

0 

1 


1 

- 0.92857 

0 1 

- 0.03571' 

6 

-28 

26 

1 

’ - 28 ’ 

6 

-28 

26 

1 

0 

6 

-28 

1 

0 

6 

-28 

1 


- 0.92857 

- 22.42858 

0 1 
26 

- 0.03571] 
L21426 

1 , ,1 

[o 1 

- 0.92857 

1 

0 

- L15924 

- 0.03571] 

- 0.05414 

6 

-28 

i J 

(-22.42858) 


6 

-28 

i J 


[1 

- 0.92857 

0 

- 0.03571] 

P 

1 

-115924 

-0.05414 . 

L° 

0 

- 2104456 

132484 J 


From the last equation, we get y, = 1-32484 _ _ q 06295. 

3 - 2L04456 

Back substitution gives 

y 2 = - 0.05414 - 1.15924(0.06295) = - 0.12711, 
y 1 = - 0.03571 - 0.92857(0.12711) = - 0.15374. 

We also have A = - 0.70208, B = 0.45208, y(0.5) = Ae~ 0 - 5 + Be~ 2 = 0.11465. 

Now, | error at* = 0.5 | = | y 2 -y(0.5) | = | - 0.12711 + 0.11465 | = 0.01246. 

0.01246 

Percentage relative error = ^ (100) = 10.8%. 

0.11465 

Example 5.6 Solve the boundary value problem 

(1 +x 2 Y'+ 4 xy'+ 2\y = 2, y(0) = 0,y(l) = 1/2 
by finite difference method. Use central difference approximations with h = 1/3. 
Solution We have h = 1/3. The nodal points are x Q = 0,x 1 = 1/3, x 2 = 2/3, x 3 = 1. 
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Using the central difference approximations, we obtain 


A (1 + xf)[y i+ 1 - 2yi + ^ (y i+1 - y^) + 2y t = 2 

h Ah, 

or [9(1 + xf) - 6xjy^ + [2 - 18(1 + xf)]y t + [9(1 + xf ) + 6xjy i+1 = 2. 

We have the following difference equations. 

For i = 1, x-l = 1/3, y 0 = 0 : 


9 1+ hr 2 P'o+ 2-18 1+- Ji+ 9 1+- +2 3-2-2 


9. 


9 J 


or - 18)^ + 12y 2 = 2. 

For / = 2, x 1 = 2/3, y 3 = 1/2 : 


-4 y 1+ 2-18 1+- 


or 9 y 1 - 24 y 2 = - 6.5. 

Solving the equations 

- 9 y x + 6y 2 = 1, 9 y 1 - 24 y 2 = - 6.5 

we obtain y . = = 0.092592, y 2 = = 0.305556. 

1DZ lbZ 


- ( REVIEW QUESTIONS j - 

1. Write the first order difference approximations for y'(xf) based on (i) forward differ¬ 
ences, (ii) backward differences. 

Solution 

(i) y'(x) = [y i+ i - yf\/(h), (ii) y'(xf) = \y • -y^Vh, where h is the step length. 

2. Write the second order difference approximations for (i) j/(x.), (ii)y"(x j ) based on central 
differences. 

Solution (i) y'(x) = ]y i+1 - y il ]l(2h), (ii) y'Xxf) = \y i+1 - 2y t + y^Vh 2 , 
where h is the step length. 

3. Finite difference methods when applied to linear second order boundary value prob¬ 
lems in ordinary differential equations produce a system of linear equations Ay = b. 
What is the structure of the coefficient matrix A ? 

Solution Tridiagonal matrix. 

4. What types of methods are available for the solution of linear system of algebraic 
equations ? 

Solution (i) Direct methods, (ii) Iterative methods. 
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5. When iterative methods are used to solve the linear system of algebraic equations, 
under what conditions convergence to the exact solution is guaranteed? 

Solution A sufficient condition for convergence is that the coefficient matrix A should 


be diagonally dominant, that is, | a u \ > ^ | a t j \. That is, in this case convergence is 


j- 


guaranteed. Since it is a sufficient condition, it implies that the system may converge 
even if the system is not diagonally dominant. 



Solve the following boundary value problems using the finite difference method and central 
difference approximations. 

1. y" = xy, y(0) = 0, y(l) = 1 with h = 0.25. 

2. y" = y + 1, y(0) = 0, y(l) = e - 1 with h = 1/3. If the exact solution is y(x) = e x - 1, find the 
absolute errors at the nodal points. 

3. y" = (y + l)/4, y(0) = 0, y(l) = 4e - 1 with h = 1/4. 

4. y" = y' + 1, y(0) = 1, y(l) = 2(e - 1) with h = 1/3. If the exact solution is y(x) = 2e x - x - 1, 
find the absolute errors at the nodal points. 

5* y" — y = ~ 4xe x , y(0) = 0, y(l) = 1 with h = 0.25. 

6 . y" = 2 x~ 2 y + x~\ y( 2) = 0, y(3) = 0 with h = 1/3. 

7. y" + 3y' + 2y = 1, y(0) = 1, y(l) = 0 with h = 1/3. 

8. y" - 3 y' + 2y = 0, y(l) = 2, y(2) = 0 with h = 1/4. 

9. x 2 y" = 2y-x, y(2) = 0, y(3) = 0 with h = 1/3. 

10. Solve the boundary value problem y" - 10 y' = 0,y(0) = 0,y(l) = 1 with h = 0.25, by using 
central difference approximation to y" and (i) central difference approximation to y', (ii) 
backward difference approximation to y', (Hi) forward difference approximation to y'. If 
the exact solution is y(x) = (e Wx - l)/(e 10 - 1), compare the magnitudes of errors at the 
nodal points in the three methods. 

5.3 CLASSIFICATION OF LINEAR SECOND ORDER PARTIAL DIFFERENTIAL 
EQUATIONS 

In this and later sections, we shall study the numerical solution of some second order linear 
partial differential equations. Most of the mathematical models of the physical systems give 
rise to a system of linear or nonlinear partial differential equations. Since analytical methods 
are not always available for solving these equations, we attempt to solve by numerical meth¬ 
ods. The numerical methods can broadly be classified as finite element methods and finite 
difference methods. We shall be considering only the finite difference methods for solving 
some of these equations. 
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First, we classify the linear second order partial differential equation 

Au xx + 2Bu xy + Cu yy + Du x + Eu y + Fu + G = 0 (5.17) 

where A, B, C, D, E, F and G are functions of x, y or are real constants. 

The partial differential equation is called a 

Elliptic equation if B 2 -AC < 0 (5.18 i ) 

Parabolic equation if B 2 - AC = 0 (5.18 ii) 

Hyperbolic equation if B 2 -AC > 0 . (5.18 Hi) 


Remark 3 Some books write the coefficient of u xy in Eq.(5.17) as B. Then, the condition in 
Eq.(5.18) changes to B 2 — 4 AC. Note that the lower order terms do not contribute to the classi¬ 
fication of the partial differential equation. 


The simplest examples of the above equations are the following: 


Parabolic equation: u t = c 2 u xx , 

(One dimensional heat equation). 

(5.19) 

Hyperbolic equation: u tt = c 2 u xx , 

(One dimensional wave equation). 

(5.20) 

Elliptic equation: u xx + u yy - 0, 

We can verify that 

(Two dimensional Laplace equation). 

(5.21) 

in Eq.(5.19), A = c 2 , B = 0, C = 0 

and B 2 - AC = 0. 


in Eq.(5.20), A = c 2 , B = 0, C = - 1 

and B 2 -AC = c 2 > 0. 


in Eq.(5.21), A = 1, B = 0, C=1 

and B 2 - AC = - 1 < 0. 



Remark 4 What is the importance of classification ? Classification governs the number and 
type of conditions that should be prescribed in order that the problem has a unique solution. 
For example, for the solution of the one dimensional heat equation (Eq.(5.19)), we require an 
initial condition to be prescribed, u(x, 0) = fix), and the conditions along the boundary lines x 
= 0, and x = l, where l is the length of the rod (boundary conditions), are to be prescribed. 

Suppose that the one dimensional wave equation (Eq.(5.20)) represents the vibrations 
of an elastic string of length l. Here, u(x, t ) represents the displacement of the string in the 
vertical plane. For the solution of this equation, we require two initial conditions to be pre¬ 
scribed, the initial displacement u(x, 0) = fix), the initial velocity ufx, 0) = g(x), and the 
conditions along the boundary lines x = 0 andx = l, (boundary conditions), are to be prescribed. 

For the solution of the Laplace’s equation (Eq.(5.21)), we require the boundary condi¬ 
tions to be prescribed on the bounding curve. 

Remark 5 Elliptic equation together with the boundary conditions is called an elliptic boundary 
value problem. The boundary value problem holds in a closed domain or in an open domain 
which can be conformally mapped on to a closed domain. For example, Laplace’s equation 
(Eq.(5.21)) may be solved inside, say, a rectangle, a square or a circle etc. Both the hyperbolic 
and parabolic equations together with their initial and boundary conditions are called initial 
value problems. Sometimes, they are also called initial-boundary value problems. The initial 
value problem holds in either an open or a semi-open domain. For example, in the case of the 
one dimensional heat equation (Eq.(5.19)), x varies from 0 to l and t > 0. In the case of the one 
dimensional wave equation (Eq.(5.20)), x varies from 0 to l and t > 0. 
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Example 5.7 Classify the following partial differential equations. 

(a) u^ = 6u x + 3u y . ( b ) 2u xx + 3u yy -u x + 2u y = 0. 

(c) u tt + 4u tx + 4u xx + 2u x + u { = 0. ( d ) u^ + 2xu xy + (1 - y 2 )u yy = 0. 

Solution 

(а) Write the given equation as u xx - 6 u x - 3 u = 0. We have A = % B = 0, C = 0 and 
B 2 - AC = 0. Hence, the given partial differential equation is a parabolic equation. 

(б) We have A = 2, B = 0, C = 3 andfi 2 -AC = - 6 < O.Hence, the given partial differential 
equation is an elliptic equation. 

(c) We have A = 1, B = 2, C = 4 and B 2 — AC = 0. Hence, the given partial differential 
equation is a parabolic equation. 

id) We have A = 1, B = x, C = 1 - y 2 and B 2 - AC = x 2 - (1 - y 2 ) = x 2 + y 2 - 1. Hence, if 
x 2 +y 2 - 1 > 0, that is, outside the unit circle 
x 2 +y 2 = 1, the given partial differential equa¬ 
tion is an hyperbolic equation. If x 2 + y 2 - 1 
= 0, that is, on the unit circle x 2 + y 2 = 1, the 
given partial differential equation is a para¬ 
bolic equation. Ifx 2 +y 2 -l< 0,that is, inside 
the unit circle x 2 + y 2 = 1, the given partial 
differential equation is an elliptic equation 
(see Fig. 5.2). 



Fig. 5.2. Example 5.7. 


- ( EXERCISE 5.2 ) - 

Classify the following partial differential equations. 

1. u^ + 4 u yy = u x + 2 u y = 0. 2. u xx - u yy + 3 u x + 4u y = 0. 

3. Uxx + 4xu xy + (1 - 4 y 2 )u yy = 0. 4 . u tt + (5 + 2 x 2 )u xt + (1 + x 2 )(4 + x 2 )u xx = 0. 

5. u^ + 4u xy + (x 2 + 4y 2 )u yy = x 2 + y 2 . 


5.4 FINITE DIFFERENCE METHODS FOR LAPLACE AND POISSON EQUATIONS 

In this section, we consider the solution of the following boundary value problems governed by 
the given partial differential equations along with suitable boundary conditions. 

(а) Laplace’s equation: u^ + u yy = V 2 u = 0, with u(x, y) prescribed on the boundary, that 
is, u(x, y) = fix, y) on the boundary. 

(б) Poisson’s equation: u xx + u yy = V 2 u = G(x, y), with u(x, y) prescribed on the boundary, 
that is, u(x, y) = g(x, y) on the boundary. 

In both the problems, the boundary conditions are called Dirichlet boundary conditions 
and the boundary value problem is called a Dirichlet boundary value problem. 

Finite difference method We have a two dimensional domain {x,y) e R. We superimpose on 
this domain R, a rectangular network or mesh of lines with step lengths h and k respectively, 
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parallel to the x- and y-axis. The mesh of lines is called a grid. The points of intersection of the 
mesh lines are called nodes or grid points or mesh points. The grid points are given by (x., yj), 
(see Figs. 5.3 a, b), where the mesh lines are defined by 

x- = ih,i = 0, 1, 2, ...; yj = jk,j = 0, 1, 2, ... 

If h = k, then we have a uniform mesh. Denote the numerical solution at (x^, yj) by u i ■. 


y 


O 


y 


o 


Fig. 5.3a. Nodes in a rectangle. Fig. 5.3b. Nodes in a square. 

At the nodes, the partial derivatives in the differential equation are replaced by suit¬ 
able difference approximations. That is, the partial differential equation is approximated by a 
difference equation at each nodal point. This procedure is called discretization of the partial 
differential equation. We use the following central difference approximations. 


(U x \j = ( u i+l,j ~ u i- lj)> ( U y\j = ^ (“j» j+ 1 “ U i,j-d> 


( U Ji,j = j2 ^UIJ ~ 2u iJ + ( U yyh,j = ^2 K j +1 “ 2u iJ + U ,> J- !>• 

Solution of Laplace’s equation We apply the Laplace’s equation at the nodal point ( i, j). 
Inserting the above approximations in the Laplace’s equation, we obtain 

(»__),• ; + ; = - 2 u ; ■ + u ; . ,) + (u ; , - 2«, • + w, .= 0 (5.22) 

xxl ’ J yyi ’ J h 2 l+1 ’ J l ’ J l ~ 1 ’ ] k 2 1 J+1 l ’ J ’ J 

or ( u i+i j ~ 2 u t j + u i X j) + p 2 (u i j +1 - 2u i j + u i / ^ 1 ) = 0, where p = h/k. (5.23) 

If h = k, that is,p = 1 (called uniform mesh spacing), we obtain the difference approximation as 
u i+ij + u i-ij + u ij+i + u ij -1 “ = 0 (5.24) 

This approximation is called the standard five point formula. We can write this formula as 

u iJ = \ + u i-iJ + u i,j+ 1 + (5.25) 

We observe that u i ■ is obtained as the mean of the values at the four neighbouring 
points in the x and y directions. 

The nodal points that are used in computations are given in Fig.5.4. 

Remark 6 The nodes in the mesh are numbered in an orderly way. We number them from left 
to right and from top to bottom or from bottom to top. A typical numbering is given in Figs.5.5a, 
5.5b. 
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Fig. 5.4. Standard five point formula. 



Fig. 5.5a. Numbering of nodes. Fig. 5.5b. Numbering of nodes. 

System of equations governing the solutions The difference approximation (5.23) or (5.24), 
to the Laplace equation u xx + u yy = V 2 u = 0 is applied at all the nodes and the boundary 
conditions are used to simplify the equations. The resulting system is a linear system of alge¬ 
braic equations Au = d. 

Structure of the coefficient matrix Let us write the system of equations that arise when 
we have nine nodes as given in Fig. 5a. Since the boundary values are known, we have the 
following system of equations. 


At 1: 

U 2 + U i ~ 4 U 1 

= b v 

or 

- 4 u 7 + u 2 + u A = b v 

At 2: 

U 1 + U 5 + U 3 ~ 4^2 

= b 2 , 

or 

u 7 - 4u 2 + u 3 + u 5 = b 2 , 

At 3: 

ll 2 + u 6 - 4 u 3 

= b 3 , 

or 

u 2 - 4u 3 + u 6 = b 3 , 

At 4: 

u 1 + u 7 + u 5 - 4u 4 

= b 4’ 

or 

u x - 4u 4 + u 5 + u 7 = b 4 , 

At 5: 

u 2 + u 4 + u 8 + u 6 - 4u 5 

= 0, 

or 

u 2 + u 4 - 4 u 5 + u G + u 8 = 0, 

At 6: 

u 3 + u 5 + u 9 - 4w 6 

= b 8 , 

or 

u 3 + u 5 - 4 u 6 + u 9 = b e , 

At 7: 

u 4 + n 8 - 4 u 7 

= b 7 . 

or 

u 4 - 4 u 7 + u 8 = b 7 , 

At 8: 

At 9: 

u 5 + u 7 + u 9 - 4 u 8 
u 6 + u 8 - 4u 9 

= b 8 , 

= b 9 . 

or 

u 5 + u 7 - 4 u 8 + u 9 = b 8 , 


where b v b 2 , b 3 , b 4 , b 6 , b 7 , b 8 , b 9 are the contributions from the boundary values. 
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We have the following linear algebraic system of equations, 
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0 

0 

0 

0 

0 

1 

0 

1 

-4 

u 9 


b 9 


which is of the form Au = d. 


Remark 7 Do you recognize the structure of the matrix ? It is a band matrix system. The half 
band width is the number of nodal points on each mesh line, that is, 3. Therefore, the total 
band width of the matrix is 3 + 3 + 1 = 7, that is, all the non-zero elements are located in this 
band. In the general case, for a large n x n system (n unknowns on each mesh line), the half 
band width is n and the total band width isn + n + l = 2n + l. All the elements on the leading 
diagonal are non-zero and are equals to - 4. Except in the case of the equations corresponding 
to the nodal points near the boundaries, all the elements on the first super-diagonal and the 
first sub-diagonal are non-zero and are equal to 1. The remaining two non-zero elements 
(which equals 1) corresponding to each equation are located in the band. For equations corre¬ 
sponding to the nodal points near the boundary, the number of non-zero elements is less than 
5. At the corner points, the number of non-zero elements is 3 (in the above example, u v u 3 , u 7 , 
u 9 are corner points) and at other points near the boundaries (in the above example, u 2 , u 4 , u 6 , 
u 8 are these points), the number of non-zero elements is 4. The remaining elements in the 
matrix are all zero. This property is true in all problems of solving Dirichlet boundary value 
problems for Laplace’s equation. The software for the solution of such band matrix systems is 
available in all computers. 

Remark 8 Let us derive the error or truncation error ( T.E ) in the approximation for the 
Laplace’s equation. Consider the case of uniform mesh, that is, h = k. Using the Taylor series 
expansions in Eq.(5.23) with h - k, we obtain 

[{u(x i+1 , yj) - 2u(x i , yj) + uix^, yj)} + {u(x p y j+1 ) - 2u(x i , yj) + u(x p y^)}] 


u +h + 

h 2 d 2 u 

h 3 

d 3 u 

h 4 d 4 u 

dx 

2 dx 2 

6 

dx 3 

24 dx 4 

( u - h *L + 

h 2 d 2 u 

h 3 

d 3 u 

h 4 d 4 u 

^ dx 

2 dx 2 

" 6 

dx 3 

+ 24 dx 4 " 

L + h du 

h 2 d 2 u 

h 

3 d 3 i 

i h 4 d 4 u 


2 dy 2 

6 dy 

3 24 dy 4 

(u- h *L + 

h 2 d 2 u 

h 3 

d 3 u 

h 4 d 4 u 

r * 

2 dy 2 

" 6 

"ft* 

24 dy 4 
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since, 


d 2 u 
-2~ 

dx dy z 



The truncation error of the method (5.23) when h = k, is given by 


T.E - (u i+l j 2 Uj j + l + (u ij+1 2u i j + u { j_f) 



using the above derivation. Hence, the truncation error of the method is of order 0(h A ). 
The order of the formula (5.23) is defined as 


Order = X (T.E) = Oih 2 ). 
h 


We say that the method is of second order. 

What is the importance of the order of the finite difference formulas ? When a method con¬ 
verges, it implies that the errors in the numerical solutions -» 0 as h -> 0. Suppose that a 
method is of order 0(h 2 ). Then, if we reduce the step length h by a factor, say 2, and re¬ 
compute the numerical solution using the step length hi 2 , then the error becomes 0[(hl2) 2 ] = 
[0(h 2 )]\IA. Therefore, the errors in the numerical solutions are reduced by a factor of 4. This 
can easily be checked at the common points between the two meshes. 

Another five point formula The standard five point formula (5.23) or (5.24) at (i, j) uses the 
four neighbours, (i + 1 ,j), (i - 1 ,j), (i,j + 1), ( i , j - 1), on thex andy axis. We can obtain another 
five point formula by using the four neighbours on the diagonals, ( i + 1 , j + 1), (i - 1 , 
j + 1), (i + 1, j -1), (i - 1, j - 1). The five point formula for solving the Laplace’s equation is 
given by 


KA, + Kkj = 2h * 


i 


(“i + lj + l + U i-XM + u i + i,j-i + U i-\M ~ Au i,? = 0 (5 ’ 26) 


or 


or 


U i+l,j+l + U i-1, j+1 + U i+lJ-l + Au i,j ~ 0 

U i,j ~ 4 (“i+lj+l + U i-l,j+l + U i+l,j-l + U i-X,j-i)- 


(5.28) 


(5.27) 


Note the factor 2 in the denominator of (5.26). This formula is called the diagonal five 
point formula. The nodal points are given in Fig.5.6. Using the Taylor series expansions as in 
Remark 8, we obtain the error or truncation error (T.E) in the formula as 
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The order of the formula is given by 

Order = Jr (T.E) = 0(h 2 ). 

Therefore, the orders of the standard and the diagonal five point formulas are the same. 
Solution of the system of equations The solution of the system of equations can be ob¬ 
tained by direct or iterative methods. For the purpose of our study, we shall consider the 
solution of the system of equations Au = d by Gauss elimination (a direct method) and an 
iterative method called Liebmann iteration, which is the application of Gauss-Seidel iterative 
method to the present system. When the order of the system of equations is not large, say 
about 50 equations, we use the direct methods. Di¬ 
rect methods require the loading of all the elements 
of the coefficient matrix and the right hand side 
vector into the memory of the computer, which may 
not be possible if the system is large. When the or¬ 
der of the system is large, which is the case in most 
practical problems, we use the iterative methods. 

In fact, in many problems, we encounter thousands 
of equations. Iterative methods do not require the 
loading of all the elements of the coefficient matrix 
and the right hand side vector. Information of few 
equations only can be loaded at a time. 

Solution of Poisson equation Consider the solution of the Poisson’s equation 

u xx + u yy = V 2 u = G(x, y ), 

with u(x, y) prescribed on the boundary, that is, u(x, y) = g(x, y) on the boundary. 

Eqs. (5.23M5.25) become 

1 1 

+ (UyyiiJ = (%+lJ “ 2U iJ + U i-1,) + j2 (U iij+ 

or (“j+ij ~ 2u i,j + u i-ij + P 2 

where G- ■ = G(x t , yj) and p = h/k. 

If h = k, that is, p = 1, we obtain the difference approximation as 

u i+i j + u i -1 j + u i j +1 + u i j- 1 - 4 u i j = h 2 Gi j ■ (5.31a) 

This approximation is called the standard five point formula for Poisson’s equation. 
The formula (5.30) is of order Oih 2 + k 2 ) and formula (5.31a) is of order Oih 2 ). We also call it a 
second order formula. 

When h = k, the diagonal five point formula for solving the Poisson’s equation can be 
written as 

u i + U + i + u i-i , j+ 1 + ~ 4u u = 2h2G ij ■ ( 5 - 31fe ) 

We shall illustrate the application of the finite difference method through the following 
examples. 


1 -2u ij + u iJ _ 1 ) = G ij (5.29) 
: -2 u ij + u iJ _ 1 ) = h 2 G ij , (5.30) 


Fig. 5.6. Diagonal five point formula. 
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Example 5.8 Solve u xx + u yy = 0 numerically for the following 
mesh with uniform spacing and with boundary conditions as 
shown below in the figure 5. 7. 

Solution We note that the partial differential equation and 
the boundary conditions are symmetric about the diagonals 
AC and BD. Hence, u 1 = u 4 and u 2 = u 3 . Therefore, we need to 
solve for two unknowns u 1 and u 2 . We use the standard five 
point formula 


We obtain the following difference equations. 


6 3 

Fig. 5.7. Example 5.8. 


At 1: u 2 + 3 + 3 + u 3 - 4u 4 = 0, 

or - 4u 1 + 2 u 2 = - 6, or - 2u x + u 2 = - 3. 

At 2: 6 + 6 + u 1 + u 4 - 4 u 2 = 0, or 2 u x - 4u 2 = - 12. 
Adding the two equations, we get - 3 u 2 = - 15, or u 2 = 5. 


From the first equation, we get 2 u t = u 2 + 3 = 5 + 3 = 8, or u x = 4. 


Example 5.9 Solve u xx + u yy = 0 numerically for the following 
mesh with uniform spacing and with boundary conditions 
as shown below in the figure 5.8. 

Solution We note that the partial differential equation and 
the boundary conditions are symmetric about the diagonal 
BD. Hence, u 2 = u 3 and we need to determine u ] ,u 2 and u A . 
We use the standard five point formula 


We obtain the following difference equations. 



Atl: u 2 + 2 + 2 + u 3 - 4u x = 0, 
At 2 6 + 4 + u x + u 4 - 4u 2 = 0, 

At 4: 8 + u 2 + u 3 + 8 - 4 u 4 = 0, 


or - 4u x + 2 u 2 = - 4, 
or u x - 4u 2 + u 4 = - 10. 
or 2 u 2 - 4u 4 = - 16, 


or - 2 u 4 + u 2 = - 2. 
or u 2 - 2 u 4 = - 8. 


We solve the system of equations using the Gauss elimination method. We use the 
augmented matrix [A | d]. 


'-2 

1 

0 1 

-2 

R 

“1 

-1/2 

0 1 

1" 



l 

-1/2 

0 I 

1' 
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-4 

1 

-10 

’ -2’ 

1 

-4 

1 

-10 

; #2 

-R 1; 

0 

-7/2 

1 

-11 

0 

1 

-2 

-8 

0 

1 

-2 

-8 



0 

1 

-2 

-8 


"1 -1/2 0 1 

r 


'1 -1/2 0 1 

1 

0 1 -2/7 

0 1-2 

22/7 

-8 

; R 3 — i? 2 , 

0 1 -2/7 

0 0 -12/7 

22/7 

-78/7 


R 2 

A772)’ 
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Solving the last equation, we get 
Substituting in the second equation, we get 
Substituting in the first equation, we get 


78 

“4= 12 =6 ' 5 ' 


u 2 = — + — = — = 


U-, = 1 + — = 3.5 . 


5. 


Example 5.10 Solve + u yy = 0 numerically for the following 
mesh with uniform spacing and with boundary conditions as 
shown below in the figure 5.9. 

Solution We note that the boundary conditions have no sym¬ 
metry. Therefore, we need to find the values of the four un¬ 
knowns u l ,u 2 ,u 3 and u 4 . We use the standard five point for¬ 
mula 


%]+1 T 


%J -1 


We obtain the following difference equations. 

Atl: u 2 + 2 + 0 + u 3 - 4u 4 = 0, or - 4u 1 + u 2 + u 3 

At 2 1 + 3 + u 1 + u 4 - 4u 2 = 0, or u x - 4 u 2 + u 4 

At 3: u 4 + u 1 + 0 + 0 - 4 u 3 = 0, or u 1 - 4u 3 + u 4 

At 4: 2 + u 2 + u 3 + 0 - 4 u, = 0, or u 2 + u 3 - 4u. 


2_3 


0 - - --- 1 

0-—-—-2 


0 0 

Fig. 5.9. Example 5.10. 


= - 2 . 
= - 4. 
= 0 . 

= - 2 . 


We solve the system of equations using the Gauss elimination method. We use the 
augmented matrix [A | d]. 
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1 

-1/4 

-1/4 

0 

1/2 

0 

1 

-1/15 

-4/15 

1845 

0 

0 

1 

-16/56 

12/56 

0 

0 

0 

-2880/840 

-2880/840 


Last equation gives u 4 = 1. 


Substituting in the third equation, we get 


U 3 


12 16 _ 28 
56 + 56 “ 56 


= 0.5. 


Substituting in the second equation, we get u 2 = 


18 1 4 45 „ „ 

-1-1-— — = 1.5. 

15 30 15 30 


Substituting in the first equation, we get u 1 = — + — + — = 1 

Example 5.11 Solve it n + u yy = 0 numerically under the bound¬ 
ary conditions 

u(x, 0) = 2x, u{0 , y)=-y, 
u(x, l) = 2x-l, u(l,y) = 2-y 

with square mesh of width h = 1/3. u 

Solution The mesh is given in Fig.5.10. We need to find the 
values of the four unknowns u v u 2 , u 3 and u 4 . We use the 
standard five point formula 

u i+ 1 j + u i x . + U t j +1 + U i . % - 4 U t j = 0. Fig. 5.10. Example 5.11 . 

Using the boundary conditions, we get the boundary values as 



^ =o- 1 = -^.“6=^k > 1 U 7 =u \0,{ 


2 

3 


U 8 = U =2-0 = 0 ’ U 9 =M °,o 



5 

3 ’ 



We obtain the following difference equations. 


Atl: 

u 2 + u 5 + u 7 + u 3 - 4u x 

= 0, 

or 

- 4 u x + u 2 + u 3 = 1. 

At 2: 

u 8 + u 6 + u x + u 4 — 4 u 2 

= 0, 

or 

u x - 4u 2 + u 4 = - 5/3. 

At 3: 

u 4 + u x + u 9 + u n - 4u 3 

= o, 

or 

u x - 4u 3 + u 4 = - 1/3. 

At 4: 

u 10 +u 2 + u 3 + u 12 - 4u 4 

= 0, 

or 

u 2 + u 3 - 4u 4 = - 3. 
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We solve the system of equations using the Gauss elimination method. We use the 
augmented matrix [A|d]. 
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Last equation gives u 4 = 1. 

Substituting in the third equation, we get u 3 = 0.04762 + 0.28572 = 0.33334. 
Substituting in the second equation, we get 

u 2 = 0.37778 + 0.06667 (0.33334) + 0.26667 = 0.66667. 
Substituting in the first equation, we get u 1 = - 0.25 + 0.25(0.66667 + 0.33334) = 0. 
Example 5.12 Solve the boundary value problem for the Poisson equation 
u xx + u yy = x 2 - 1, | x | <1, | y | <1, 

u = 0 on the boundary of the square 
using the five point formula with square mesh of width h = 1/2. 
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Solution The mesh is given in Fig.5.11. The partial differential equation and the boundary 
conditions are symmetric about x-and y-axis. We need to find the values of the four unknowns 
u v u 2 , u 3 and u 4 . We use the standard five point formula 



Fig. 5.11. Example 5.12. 

U i+1 j + U i -1 j + U i j +1 + U i j-1 ~ 4 u i j = h 2 Gi j = 0.25(^ 2 - 1). 
We obtain the following difference equations. 


At 1(0, 0): u 2 + u 3 + u 2 + u 3 - Au x = - 0.25, 

or - 2 u x + u 2 + u 3 = - 0.125. 

At 2(0.5, 0): 0 + u 4 + u x + u 4 - 4u 2 = 0.25(0.25 - 1) = - 0.1875, 

or n 1 - 4 u 2 + 2 u 4 = - 0.1875. 

At 3(0, 0.5): u i + 0 + u i + u 1 -Au 3 = 0.25(0 - 1) = - 0.25, 
or u 1 - 4 u 3 + 2u 4 = - 0.25. 

At 4(0.5, 0.5): 0 + 0 + u 3 + u 2 - Au 4 = 0.25(0.25 - 1) = - 0.1875, 

or u 2 + u 3 - Au 4 = - 0.1875. 

We solve the system of equations using the Gauss elimination method. We use the 
augmented matrix [A | d]. 
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R 3 - 0.5 R 2 , 
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0 0 1 - 0.66667 
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-0.5 

-0.5 

0 

0.0625 

0 

1 

- 0.14286 

- 0.57143 

0.07143 

0 

0 

1 

- 0.66667 

0.10156 

0 

0 

0 

-2.66667 

- 0.37500 


0.0625 
0.07143 
0.10156 
- 0.25893 


R 4 - 1.14286 R 3 , 


Last equation gives u. = — - = 0.14062. 

4 2.66667 

Substituting in the third equation, we get u 3 = 0.10156 + 0.66667(0.14062) = 0.19531. 
Substituting in the second equation, we get 


u 2 = 0.07143 + 0.14286(0.19531) + 0.57143(0.14062) = 0.17969. 
Substituting in the first equation, we get u 4 = 0.5(0.17969 + 0.19531) + 0.0625 = 0.25. 


Iterative methods We mentioned earlier that when the order of the system of equations is 
large, which is the case in most practical problems, we use iterative methods. In fact, in many 
practical applications, we encounter thousands of equations. There are many powerful itera¬ 
tive methods available in the computer software, which are variants of successive over relaxa¬ 
tion (SOR) method, conjugate gradient method etc. However, we shall discuss here, the imple¬ 
mentation of the Gauss-Seidel method for the solution of the system of equations obtained in 
the application of the finite difference methods. Let us recall the properties of the Gauss- 
Seidel method. 

(a) A sufficient condition for convergence is that the coefficient matrix A, of the system 
of equations is diagonally dominant. 

(b) The method requires an initial approximation to the solution vector u. If no suitable 
approximation is available, then u = 0 can be taken as the initial approximation. 

(c) Using the initial approximations, we update the value of the first unknown u v Using 
this updated value of u 1 and the initial approximations to the remaining variables, 
we update the value of u 2 . We continue until all the values are updated. We repeat 
the procedure until the required accuracy is obtained. 

Liebmann iteration We use the above procedure to compute the solution of the difference 
equations for the Laplace’s equation or the Poisson equation. 

The initial approximations are obtained by judiciously using the standard five point 
formula (5.25) 
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U iJ = T {U MJ + “i l,j + u U +1 + 


or the diagonal five point formula (5.28) 


“ij = | K + ij + i + “i-lj+l + U i+l,j-l + “mj-i> 
after setting the values of one or two variables as zero. 

If in some problems, these two formulas cannot be used (see Example 5.14), then we set the 
values of required number of variables as zero. 

For the mesh defined in Fig. 5.12, we write the following Liebmann iteration 


„(4 + l) _ 1 ( 7 ,(k + l) „(* + l) , ,(k) ,„(*) \ 

i " 4 K j- 1 + J + i + H J+l) 


(5.32) 


where the values at the nodes (i, j - 1), (i - 1, j) are al¬ 
ready updated (when the numbering of unknowns is from 
bottom to top). If the numbering is from top to bottom, 
then the iteration becomes 

K (* + h_ + h +u (*+! ) + u (A) 1 + u ( >\ j 

Stopping criteria for iteration 


U + 1 






->e 


We stop the iterations when the following criterion 
is satisfied 


«. 1 -1 

Fig. 5.12. Standard five point formula. 


\ u i k+1) ~ u \ k) | < given error tolerance for all i. 

For example, if we want two decimal places accuracy for the solution, then we iterate until 
the condition 


| u\ k +1) - ul h) | < 0.005 for all i (5.33) 

is satisfied. 

Similarly, if we want three decimal places accuracy for the solution, then we iterate until 
the condition 


| u\ k+l) - ul k) | < 0.0005 for all i (5.34) 

is satisfied. 

We illustrate the method through the following problems. 

Example 5.13 Solve u xx + u yy = 0 numerically, using five point formula and Liebmann iteration, 
for the following mesh with uniform spacing and with boundary conditions as shown below in 
the figure 5.13. Obtain the results correct to two decimal places. 

Solution We note that the boundary conditions have no symmetry. Therefore, we need to find 
the values of the four unknowns u v u 2 , u 3 and u 4 . We use the standard five point formula 

u i + l,j + u i-i,j + U u* i + u U -1 - 4u U = °' 
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We obtain the following difference equations. 

Atl: u 2 + 2 + 2 + u 3 - 4u 1 = 0, or - 4u 1 + u 2 + u 3 = - 4. 

At 2 1 + 3 + u 1 + u 4 - 4u 2 = 0, or u 1 - 4u 2 + u 4 = - 4. 

At 3: u 4 + u 1 + 3 + 0 - 4u 3 = 0, or u x - 4u 3 + u 4 = - 3. 

At 4: 2 + u 2 + u 3 + 0 - 4 u 4 = 0, or u 2 + u 3 - 4u 4 = - 2. 

Using these equations, we write the difference equations at 
the grid points as 

u x = 0.25(4 + u 2 + u 3 ), 
u 2 = 0.25(4 + u A + u A ), 
u 3 = 0.25(3 + u A + u A ), 
u A = 0.25(2 + u 2 + u 3 ), 
and write the iteration procedure as 

u[ k + 1) = 0.25 (4 + i4* ) + « 3 * ) )» 

4 a+1) =0.25 (4 + u[ k+1) + u ( 4 k) ), 
u ( 3 k+1) = 0.25 (3 + u[ k+1) + uf), 
u ( 4 k + 1) = 0.25 (2 + u ( 2 k+1) + u ( 3 k+1) ) • 


Fig. 5.13. Example 5.13. 


Initial approximations 

Set u 4 = u 4 )] = 0. Using the diagonal five point formula at the first node, we obtain 

u® = 0.25 (u 4 + 3 + 2 + 3) = 0.25(0 + 3 + 2 + 3) = 2. 

Now, we can use the standard five point formula to obtain initial approximations at the 
nodes 2, 3, 4. We obtain 

4 0) = 0.25 (1 + 3 + uf + 4 0) ) = 0.25(1 + 3 + 2 + 0) = 1.5. 

4 0) = 0.25 (4 0) + i4 0) + 3 + 0) = 0.25(0 + 2 + 3 + 0) = 1.25. 

4 0) = 0.25 (2 + 4 0) + wf + 0) = 0.25(2 + 1.5 + 1.25 + 0) = 1.1875. 

First iteration 

= 0.25 (4 + uf + uf) = 0.25(4 + 1.5 + 1.25) = 1.6875, 
iitjp = 0.25 (4 + + 4 0) ) = 0.25(4 + 1.6875 + 1.1875) = 1.71875, 
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uf = 0.25 (3 + uf + uf) = 0.25(3 + 1.6875 + 1.1875) = 1.46875, 
uf = 0.25 (2 + uf + Mg X) ) = 0.25(2 + 1.71875 + 1.46875) = 1.29688. 
Second iteration 

uf = 0.25(4 + 1 ^^ + uf) = 0.25(4 + 1-71875 + 1.46875) = 1.79688, 
uf = 0.25 (4 + uf + uf) = 0.25(4 + 1.79688 + 1.29688) = 1.77344, 
uf = 0.25 (3 + uf + uf) = 0.25 (3 + 1.79688 + 1.29688) = 1.52344, 
uf = 0.25 (2 + uf + uf) = 0.25(2 + 1.77344 + 1.52344) = 1.32422. 
Third iteration 

uf = 0.25 (4 + uf + uf) = 0.25(4 + 1.77344 + 1.52344) 
uf = 0.25 (4 + 14 3) + uf) = 0.25(4 + 1.82422 + 1.32422) 
uf = 0.25 (3 + uf + uf) = 0.25(3 + 1.82422 + 1.32422) 
uf = 0.25 (2 + uf + uf) = 0.25(2 + 1.78711 + 1.53711) 

Fourth iteration 

uf =0.25(4 + 4 3) +uf) = 0.25(4 + 1.78711 + 1.53711) = 1.83106, 
uf = 0.25 (4 + uf + uf) = 0.25(4 + 1.83106 + 1.33106) = 1.79053, 
uf = 0.25 (3 + uf + uf) = 0.25(3 + 1.83106 + 1.33106) = 1.54053, 
uf = 0.25 (2 + uf + u!, 4) ) = 0.25(2 + 1.79053 + 1.54053) = 1.33277. 
Fifth iteration 

uf = 0.25 (4 + uf + uf) = 0.25(4 + 1.79053 + 1.54053) = 1.83277, 
uf = 0.25 (4 + uf + uf) = 0.25(4 + 1.83277 + 1.33277) = 1.79139, 
uf = 0.25 (3 + uf + uf) = 0.25(3 + 1.83277 + 1.33277) = 1.54139, 
uf = 0.25 (2 + uf + uf) = 0.25(2 + 1.79139 + 1.54139) = 1.33320. 
At this stage, the magnitudes of the errors in the successive iterations are 
| uf — uf | = | 1.83277- 1.83106 | =0.00171, 


= 1.82422, 
= 1.78711, 
= 1.53711, 
= 1.33106. 


I uf - uf | = | 1.79139 - 1.79053 | = 0.00086, 
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I uf - uf I = I 1.54139- 1.54053 | = 0.00086, 
| u f - uf | = | 1.33320- 1.33277 | = 0.00043. 


All the errors are < 0.005. Hence, the fifth iteration values are correct to two decimal 
places. We take these values as the required solutions. 

Example 5.14 Solve the boundary value problem 


u xx + u yy =x+y + l,0<x<l,0<y<l, 
u = 0 on the boundary 


numerically using five point formula and Liebmann iteration, with mesh length h = 1/3. 
Obtain the results correct to three decimal places. 

Solution The mesh is given in Fig.5.14. We note that all the boundary values are zero. There 
is symmetry with respect the line y = x. Hence, u 1 = u A . Therefore, we need to find the values 
of the three unknowns u v u 2 and u 3 . We use the standard five point formula 



We obtain the following difference equations. 





or 




or 



Using these equations, we write the difference equations 
at the grid points as 


0 


0 


= 0.25(u 2 + u 3 - 0.222222), 
u 2 = 0.25(2 Ul - 0.259259), 
u 3 = 0.25(2^-0.185185), 


0 


0 


0 


0 


and write the iteration procedure as 


u[ k+1) = 0.25 (u ( 2 k) + u ^ - 0.222222), 
u ( 2 k+1) = 0.25 (2u[ k+1> - 0.259259) 
i4* +1) = 0.25 (2 j4* +1) - 


0 0 

Fig. 5.14. Example 5.14. 


0.185185). 
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Initial approximations Since the boundary values are all zero, we cannot use the standard or 
diagonal five point formulas to obtain the initial approximations. Hence, as in Gauss-Seidel 
method, we assume uf = uf = 0. 

First iteration 

uf = 0.25 (uf + uf - 0.222222) = - 0.05556, 

uf = 0.25 (2uP - 0.259259) = 0.25(- 0.111112 - 0.259259) = - 0.092593, 
uf = 0.25 (2uP - 0.185185) = 0.25(- 0.111112 - 0.185185) = - 0.074074. 

Second iteration 

u i 2) = 0.25 (uf + uf - 0.222222) = 0.25(- 0.092593 - 0.074074 - 0.222222) = - 0.097222 
uf = 0.25 (2uf - 0.259259) = 0.25(- 0.194444 - 0.259259) = - 0.113426, 

uf = 0.25 (2uf - 0.185185) = 0.25(- 0.194444 - 0.185185) = - 0.094907. 

Third iteration 

uf = 0.25 (uf + uf - 0.222222) = 0.25(- 0.113426 - 0.09407 - 0.222222) = - 0.107639, 
uf = 0.25 (2 uf - 0.259259) = 0.25(- 0.215278 - 0.259259) = - 0.118634, 

4 3> = 0.25 (2i4 3) - 0.185185) = 0.25(- 0.215278 - 0.185185) = - 0.100116. 

Fourth iteration 

4 4) = 0.25 (4 3) + uf - 0.222222) = 0.25(- 0.118634 - 0.100116 - 0.222222) = - 0.110243, 
4 4) = 0.25 (2i4 4) - 0.259259) = 0.25(- 0.220486 - 0.259259) = - 0.119936, 

4 4) = 0.25 (2 u[ 4) - 0.185185) = 0.25(- 0.220486 - 0.185185) = - 0.101418. 

Fifth iteration 

uf =0.25 (4 4) + 4 4) -0.222222) =0.25(-0.119936-0.101418-0.222222) = -0.110894, 
uf = 0.25 (2 uf - 0.259259) = 0.25(- 0.221788 - 0.259259) = - 0.120262, 

uf = 0.25 (2 uf - 0.185185) = 0.25(- 0.221788 - 0.185185) = - 0.101740. 

Sixth iteration 

uf = 0.25 (uf + uf - 0.222222) = 0.25(- 0.120262 - 0.101740 - 0.222222) = - 0.111056, 
uf = 0.25 (2uf - 0.259259) = 0.25(- 0.222112 - 0.259259) = - 0.120343, 

uf = 0.25 (2uf - 0.185185) = 0.25(- 0.222112 - 0.185185) = - 0.101824. 
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At this stage, the magnitudes of the errors in the successive iterations are 
| „«) _ u f | = | - 0.111056 + 0.110894 | = 0.000162, 

| - u f |=|- 0.120343 + 0.120262 | = 0.000081, 

| _ u f | = | - 101824 + 0.101740 | = 0.000084. 

All the errors are < 0.0005. Hence, the fifth iteration values are correct to three decimal 
places. We take these values as the required solutions. 


Example 5.15 Using the Liebmann method, solve the equation 
u xx + u yy = 0 for the following square mesh with boundary values 
as shown in figure. Iterate until the maximum difference between 
successive values at any point is less than 0.001. 

Solution The mesh is given in Fig.5.15. Number the nodes as 
Mj, u 2 ,u 3 and u 4 . The partial differential equation and the 
boundary values are symmetric with respect to line BD. Hence, 
u 2 = u 3 . We have three unknowns u 1 ,u 2 and u 4 . We use the 
standard five point formula 

U i + U + u i-ij + u i,j+ 1 + u i,j- 1 - 4u ij = °- 

We obtain the following difference equations. 



Fig. 5.15. Example 5.15. 


At 1: u 2 + 1 + 1 + u 2 - 4u 1 = 0, 
At 2: 4 + 2 + u 1 + u 4 - 4u 2 = 0, 
At 4: 5 + u 2 + u 2 + 5 - 4 u, = 0, 


or - 2 u 1 + u 2 = - 1. 

or u 1 - 4u 2 + u 4 = - 6 
or u 2 - 2 u, = - 5. 


Using these equations, we write the difference equations at the grid points as 


u 1 = 0.5(1 + u 2 ), u 2 = 0.25(6 + u 1 + uf), u 4 = 0.5(5 + u 2 ). 
and write the iteration procedure as 


4* +1) = 0.5(1+ 4 W ), 4 ft+1) = 0.25(6+ u[ k+1) +u ( 4 k) ), u[ k +1) =0.5(5 + u^ +1) ). 


Initial approximations 

Since the value at the corner point D is not given, we need to use the standard five point 
difference formula. Hence, we set u 2 = 0 and u 3 = 0. We have the following initial approxima¬ 
tions. 

i4 0) = 0.25(0 + 1 + 1 + 0) = 0.5, 4 0) = 0.25(5 + 0 + 0 + 5) = 2.5. 

We can update u 2 also and take the initial approximation as 

4 0) = 0.25(4 + 2 + uf + uf) = 0.25(6 + 0.5 + 2.5) = 2.25. 


Otherwise, 


becomes same as 
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First iteration 

= 0.5 (1+ uf) = 0.5(1 + 2.25) = 1625. 
uf = 0.25(6 + uf + uf) = 0.25(6 + 1.625 + 2.5) = 2.53125. 
uf = 0.5 (5 + uf) = 0.5(5 + 2.53125) = 3.76563. 

Second iteration 

uf = 0.5 (1+4 U ) = 0.5(1 + 2.53125) = 176563. 
uf = 0.25(6 + uf + uf) = 0.25(6 + 1.76563 + 3.76563) = 2.88282. 
uf = 0.5 (5 + uf) = 0.5(5 + 2.88282) = 3.94141 
Third iteration 

uf = 0.5 (1+ uf) = 0.5(1 + 2.88282) = 194141 
uf = 0.25(6 + uj® + uf) = 0.25(6 + 1.94141 + 3.94141) = 2.97070. 
uf = 0.5 (5 + uf) = 0.5(5 + 2.97070) = 3.98535 
Fourth iteration 

4 4) = 0.5 (1+ uf) = 0.5(1 + 2.97070) = 198535. 

4 4) = 0.25(6 + uf + uf) = 0.25(6 + 1.98535 + 3.98535) = 2.99268. 
uf = 0.5 (5 + uf) = 0.5(5 + 2.99268) = 3.99634. 

Fifth iteration 

uf = 0.5 (1+ uf) = 0.5(1 + 2.99268) = 199634. 

uf = 0.25(6 + uf + uf) = 0.25(6 + 1.99634 + 3.99644) = 2.99817. 

uf = 0.5 (5 + uf) = 0.5(5 + 2.99817) = 3.99909. 

Sixth iteration 

uf = 0.5 (1+ uf) = 0.5(1 + 2.99817) = 199909. 

uf = 0.25(6 + uf + uf) = 0.25(6 + 1.99909 + 3.99909) = 2.99955. 

uf = 0.5 (5 + uf) = 0.5(5 + 2.99955) = 3.99977. 
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Seventh iteration 

i4 7) = 0.5 (1+ 4 6> ) = 0.5(1+ 2.99955) = 199978. 

4 7) = 0.25(6 + u i 7) + uf) = 0.25(6 + 1.99978 + 3.99977) = 2.99989. 

4 7) = 0.5 (5 + 4 7> ) = 0.5(5 + 2.99989) = 3.99994. 

At this stage, the magnitudes of the errors in the successive iterations are 

| U V> _ | = | 1.99978 - 1.99909 | = 0.00069, 

| u<p _ „«) | = | 2.99989 - 2.99955 | = 0.00034, 

| a® _ „«) | = | 3.99994 - 3.99977 | = 0.00017. 

All the errors are < 0.001. Hence, the seventh iteration values are taken as the required 
solutions. 

u 1 ~ 1.99978, u 2 = u 3 ~ 2.99989, u i ~ 3.99994. 

- [ REVIEW QUESTIONS ) - 

1. Write the Laplace equation in two dimensions. 

Solution u xx + u yy = 0. 

2. Write the Poisson equation in two dimensions. 

Solution + u yy = G(x, y). 

3. Write the general linear second order partial differential equation in two variables. 
Solution Au xx + 2 Bu xy + Cu yy + Du x + Eu y + Fu + G = 0, 

where A, B, C, D, E, F, G are functions of x, y. 

4. When is the linear second order partial differential equation 

Au xx + 2Bu xy + Cu yy + Du x + Eu y + Fu + G = 0 
called an elliptic or hyperbolic or parabolic equation? 

Solution The given linear second order partial differential equation is called ( i ) an 
elliptic equation when B 2 -AC < 0, (ii) a hyperbolic equation when B 2 -AC > 0, and (Hi) 
a parabolic equation when B 2 — AC = 0. 

5. Write the standard five point formula for the solution of ( i) Laplace’s equation u xx + u yy 
= 0, (ii) Poisson equation u xx + u yy = G(x, y), for uniform mesh spacing h. 

Solution 

(i) u i+1 j + u i X j + u ■ j +1 + u t - 4 u t j = 0. 

(ii) u i+1 j + u i l j + u i j +1 + u t — 4u i j = h 2 G i j. 

6. Write the diagonal five point formula for the solution of (i) Laplace’s equation u xx + u yy 
= 0, (ii) Poisson equation u xx + u yy = G(x, y), for uniform mesh spacing h. 
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Solution 

(i) u i+1 j +1 + u ix j +1 + u i+1 j_ t + u iX - 4 u t j = 0 . 

(it) u i+1 j+1 + u i X j+1 + u i+1 + u ix - 4u i ■ = 2 h 2 G i ■. 

6. What is the order and truncation error of the standard five point formula for the solution of 
Laplace’s equation u xx + u yy = 0, with uniform mesh spacing? 

Solution The method is u i+1 j + l ■ + u ( J+1 + u ■ t l - 4u ■ j = 0. 

Order = 2, or Oih 2 ). 


h 4 f d 4 u + d 4 u^\ + 

12^ + ^J. + ' 


7. What is the order and truncation error of the diagonal five point formula for the solution of 
Laplace’s equation u xx + u yy = 0, with uniform mesh spacing ? 

Solution The method is u i+1 j+1 + u i X j+1 + u i+1 y l + u i X J X - 4u ■ . = 0. 

Order = 2, or Oih 2 ). 


d 4 u „ d 4 u d 4 v 

—j- + 6 —z—^- + — - 

dx dx dy dy 


8. When do we normally use the diagonal five point formula while finding the solution of 
Laplace or Poisson equation? 

Solution We use the diagonal five point formula to obtain initial approximations for 
the solutions to start an iterative procedure like Liebmann iteration. 

9. Finite difference methods when applied to Laplace equation or Poisson equation give 
rise to a system of algebraic equations Au = d. Name the types of methods that are 
available for solving these systems. 

Solution 

(i) Direct methods like Gauss elimination method or Gauss-Jordan method can be used 
when the system of equations is small. 

(ii) Iterative methods like Gauss-Jacobi method or Gauss-Seidel method can be used 
when the system of equations is large. 

10. When do we use the Liebmann method? 

Solution We use the Liebmann method to compute the solution of the difference 
equations for the Laplace’s equation or the Poisson equation. The initial approximations 
are obtained by judiciously using the standard five point formula 

u U=\ (u i + i,j + u i-iJ +u iJ + i +u iJ-J 
or the diagonal five point formula 


u t j= — (u i+1 j+1 + u i X j+1 + u i+1 j_ x + u i X j_ j) 
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after setting the values of one or two variables as zero. If in some problems, these two 
formulas cannot be used, then we set the values of required number of variables as zero. 

11. What is the condition of convergence for the system of equations obtained, when we 
apply finite difference methods for Laplace’s or Poisson equation? 

Solution A sufficient condition for convergence of the system of equations is that the 
coefficient matrix A of the system of equations Au = d, is diagonally dominant. This 
implies that convergence may be obtained even if A is not diagonally dominant. 

12. What is the importance of the order of a finite difference method? 

Solution When a method converges, it implies that the errors in the numerical solutions 
—> 0 as h —> 0. Suppose that a method is of order 0(h 2 ). Then, if we reduce the step 
length h by a factor, say 2, and re-compute the numerical solution using the step length 
hi 2, then the error becomes O[(A/2) 2 ] = [0 (/i 2 )]/4. That is, the errors in the numerical 
solutions are reduced by a factor of 4. This can easily be checked at the common points 
between the two meshes. 


- ( EXERCISE 5.3 ) - 

Find the solution of the Laplace equation u xx + u yy = 0 in the given region R, subject to the given 
boundary conditions, using the standard five point formula. 


1/9 4/9 

Fig. 5.16. Problem 1. 


3 5 

Fig. 5.17. Problem 2. 
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100 200 


0 

0 
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3 


0 0 


Fig. 5.18. Problem 3. 


Fig. 5.19. Problem 4. 
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5. R is a square of side 3 units. Boundary conditions are u( 0, y) = 0, u{ 3, y) = 3 + y, u(x, 0) 
= x, u{x, 3) = 2x. Assume step length as h = 1. 

6. R is a square of side 1 unit. u(x, y) = x -y on the boundary. Assume h = 1/3. 

Find the solution of the Poisson’s equation u xx + u yy = G(x, y) in the region R, subject to the 
given boundary conditions. 

7. I? : 0 < x < 1, 0 < y < 1. Gix, y) = 4. uix, y) = x 2 + y 2 on the boundary and h = 1/3. 

8. i? : 0 < x < 1, 0 <y < 1. Gix, y) = 3x + 2y. u(x, y) = x-y on the boundary and h = 1/3. 

9. i?:0<x<3, 0 < y < 3. G(x, y) = x 2 + y 2 . u(x, y) = 0 on the boundary and h = 1. 

10. In Problems 2, 3, 4, 8, 9, solve the system of equations using the Liebmann iteration. In 

Problem 2, take the value at the top left hand point as - 2. In Problem 3, take the value 
at the top left hand point as 300. In Problem 4, take the value at the top left hand point 
as O.Perform four iterations in each case. 


5.5 FINITE DIFFERENCE METHOD FOR HEAT CONDUCTION EQUATION 

In section 5.3, we have defined the linear second order partial differential equation 
Au^ + 2Bu xy + Cu yy + Du x + Eu y + Fu + G = 0 

as a parabolic equation if B 2 - AC = 0. A parabolic equation holds in an open domain or in a 
semi-open domain. A parabolic equation together with the associated conditions is called an 
initial value problem or an initial-boundary value problem. The simplest example of a para¬ 
bolic equation is the following problem. 

Consider a thin homogeneous, insulated bar or a wire of length l. Let the bar be located 
on the x-axis on the interval [0, /]. Let the rod have a source of heat. For example, the rod may 
be heated at one end or at the middle point or has some source of heat. Let uix, t) denote the 
temperature in the rod at any instant of time t. The problem is to study the flow of heat in the 
rod. The partial differential equation governing the flow of heat in the rod is given by the 
parabolic equation 

u t = c ^ u xx > 0 < x < Z, / > 0. (5.35) 

where c 2 is a constant and depends on the material properties of the rod. In order that the 
solution of the problem exists and is unique, we need to prescribe the following conditions. 

ii) Initial condition At time £ = 0, the temperature is prescribed, uix, 0) = fix), 0 < x < l. 
Hi) Boundary conditions Since the bar is of length l, boundary conditions atx = 0 and at 
x = l are to be prescribed. These conditions are of the following types: 

(a) Temperatures at the ends of the bar is prescribed 

u( 0, t) = git), u(l, t) = hit), t > 0. (5.36) 

ib) One end of the bar, say at x = 0, is insulated. This implies the condition that 


— = 0, at x = 0 for all time t. 
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At the other end, the temperature may be prescribed, u(l, t) = h(t), t > 0. 

Alternatively, we may have the condition that the end of the bar at x = l is insulated. 
Since both initial and boundary conditions are prescribed, the problem is also called an 
initial boundary value problem. 

For our discussion, we shall consider only the boundary conditions given in (5.36). 

Mesh generation Superimpose on the domain 0 < x < Z, Z > 0, a rectangular network of mesh 
lines. Let the interval [0, l] be divided into M equal parts. Then, the mesh length along the 
x-axis is h = l/M. The points along the x-axis are x t = ih,i = 0, 1, 2, ..., M. Let the mesh length 
along the Z-axis be k and define tj = jk. The mesh points are (x. , tj We call t - as the j'th time 
level (see Fig.5.20). At any point (x., tj, we denote the numerical solution by u t ■ and the exact 
solution by u(x i , tj). 

Remark 9 Finite difference methods are 
classified into two categories: explicit t,k 

methods and implicit methods. In explicit 

methods, the solution at each nodal point Level 1 + 1 

on the current time level is obtained by_Level j 

simple computations (additions, sub¬ 
tractions, multiplications and divisions) Levelj-1 

using the solutions at the previous one or 
more levels. In implicit methods, we solve 
a linear system of algebraic equations for 

all the unknowns on any mesh line t = t- v - 

When a method uses the nodal values on_____ . x Leve! Q 

two time levels t- and t j+v as in Fig. 5.20, O 

then it is called a two level formula. When 

a method uses the nodal values on three Fi 9- 5 - 2 ®- Nodes, 

time levels t j V t - and t j+1 then it is called a 
three level formula. 

Let us derive a few methods. 

Explicit methods 

In Chapter 2, we have derived the relationships between the derivatives and forward differences. 
Denote A t as the forward difference in the Z-directioa Then, we can write Eq.(2.31) as 



(5.37) 


Now, use the approximation 



(5.38) 
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Using central differences, we also have the approximation 


[a?J (5 

Therefore, an approximation to the heat conduction equation (5.35) at the point (x i , is 


or u t j+1 - u t j = X [u i+1< j - 2 u it j + Ui _ % J 

or u • j *j = u t j + X [Uj +li j - 2u t j + u t _^ j] 

or u • j +1 = Xu tl j + (1 - 2X)u i j + Xu i+1 ■ 

where X = kc 2 lh 2 , is called the mesh ratio parameter. 

Note that the value u t ;+1 at the node 
{x t , tj +1 ) is being obtained explicitly using the 
values on the previous time level t -. The nodes 
that are used in the computations are given in 
Fig.5.21. This method is called the Schmidt 
method. It is a two level method. 

Truncation error of the Schmidt method 
We have the method as 

u i, j+ i ~ u ij = * K+ij - 2 “y + u i-iJ ■ 

Expanding in Taylor’s series, we obtain the left hand and right hand sides as 

. |"[ du k 2 d 2 u 1 ] [,3m k 2 d 2 u ] 

uixijtj +k)- u(x;,tj ) = Nu + k — + - ^ + ...\-u \ = \k — + - 5 - + ... 

3 3 [[ dt 2 dt 2 J J [ dt 2 & 

X [u{x i+1 , tj) - 2u(x i , tj) + u{x i V tj)] 

kc 2 I , du h 2 d 2 u h 3 d 3 u 1 I , du h 2 d 2 u h 3 d 3 u I 

h 2 Q dx 2 dx 2 6 dx 3 J [ dx 2 dx 2 6 dx 3 jJ 




[, j + 1 


1-1.1 v 

t -7 

|| 

* - ? 

1 + 1.J 


Fig. 5.21. Schmidt method. 


dx 2 12 dx 4 


"'Mi 


12 dx 4 


where all the terms on the right hand sides are evaluated at (x i , tj). The truncation error is given 
by 

T.E = u(x t , tj + k)~ u(x i , tj) - X[u(x i+V tj) - 2u(x t , tj) + u(x i V tj)] 
du k 2 d 2 u 


dt + YW + - l ~ kc + 
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k 2 d 2 u kh 2 c 2 3 4 m 

IF" 12 F 4 " 


Now, using the differential equation 


du 

~di 



d_ 

dt 



2 9 f 9 !^ _ 4iLf 92 ^l_ 

C 9^3x 2 J C dx 2 {dx 2 j C 3x 4 ’ 


we obtain 



(5.41) 


The order of the method is given by- 

order = | (T.E) = 0(h 2 + k ). 
k 


(5.42) 


Remark 10 For a fixed value of X, that is, X = kc 2 /h 2 = fixed, we have k = X h 2 /c 2 or 
A = 0(h 2 ). Hence, from (5.42), for a fixed value of X, the method is of order 0(h 2 ). That is, the 
values of A and A are reduced such that the value of A is always same. 

Remark 11 For X = 1/2, Schmidt method simplifies to 



(5.43) 


This method is also called Bender-Schmidt method. This method is also of order Oih 2 ) for 
a fixed X. 

Remark 12 For X = 1/6, the leading term in the error expression given in (5.41) vanishes. Hence, 
the truncation error of the method is of the order 0(k 3 + kh A ) ■ The order of the method is Oik 2 + 
A 4 ). Therefore, for a fixed value of X = 1/6, the method is of order 0(A 4 ) (see Remark 10). The 
higher order method is given by 



(5.44) 


Remark 13 For the solution of a boundary value problem (for Laplace or Poisson equations), 
convergence of the system of equations is important. We have noted that a sufficient condition for 
the convergence of the iteration methods is that the coefficient matrix is diagonally dominant. In 
the solution of an initial value problem, time t plays an important role. Theoretically, since t > 0, 
we are performing infinite cycles of computation. Hence, stability of the numerical computations 
plays the important role. Stability means that the cumulative effect of all errors (round-off and 
other numerical errors) —> 0 as computation progresses along t-axis. Analysis of the Schmidt 
method gives that the method is stable if 



(5.45) 



278 


NUMERICAL METHODS 


Note that the Bender-Schmidt method uses the valued = 1/2. From the condition (5.45), we 
find that the higher order method (5.44), which uses the value X = 1/6, is also stable. 

Computational procedure 

The initial condition u(x, 0) = fix) gives the solution at all the nodal points on the initial line 
(level 0). The boundary conditions u(0,t) =g(t), u{l, t ) = hit), t > 0 give the solutions at all the nodal 
points on the boundary lines x = 0 and x = l, (called boundary points), for all time levels. We choose 
a value for X and h. This gives the value of the time step length k. Alternately, we may choose the 
values for h and A. The solutions at all nodal points, (called interior points), on level 1 are obtained 
using the explicit method. The computations are repeated for the required number of steps. If we 
perform m steps of computation, then we have computed the solutions up to time t m = mk. 

Let us illustrate the method through some problems. 

Example 5.16 Solve the heat conduction equation 

u t = u xx> 0 ^ x < 1, with u{x, 0) = sin (nx), 0 < x < 1, u{ 0, t) = u( 1, t) = 0 
using the Schmidt method. Assume h = 1/3. Compute with ( i ) X = 1/2 for two time steps, 
(it) A = 1/4 for four time steps, (iii) X = 1/6 for six time steps. If the exact solution is 
u(x, t) = expl- n 2 t) sin In x), compare the solutions at time t = 1/9. 

Solution The Schmidt method is given by 

u i j +1 = ^ u i-i j + (1 - 2X)u i j + Xu i+1 j 

We are given h = 1/3. Hence, we have four nodes on each mesh line (see Fig.5.22). We have 
to find the solution at the two interior points. t 

The initial condition gives the values - 



(2 A . (2n\ V3 

“ I 3 , 0 I = “ 2,0 = sm I ■— I = — = 0.866025. 


The boundary conditions give the values u 0 ■ = 0, u 3 ■ = 0, 
for all j. 

(i) We have X = 1/2, h = 1/3, k = Xh 2 = 1/18. The 
computations are to be done for two time steps, that is, 
upto t = 1/9. For X = 1/2, we get the method 

“i,7+i = \ + u i + iJ’ j = 0, 1; i = 1, 2. 

We have the following values. 

For j = 0: i = 1: u x 1 = 0.5 (u 0fi + u 2 0 ) = 0.5(0 + 0.866025) = 0.433013. 

i = 2: u 21 = 0.5(u li0 + u 3 0 ) = 0.5(0.866025 + 0) = 0.433013. 


0 1/3 2/3 1 

Fig. 5.22. Example. 5.16. 
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For j = l:i = l: u x 2 = 0.5(w 0 x + u 21 ) = 0.5(0 + 0.433013) = 0.216507. 

i = 2: u 2 2 = 0.5(1*^ + u 31 ) = 0.5(0.433013 + 0) = 0.216507. 

After two steps t = 2k = 1/9. Hence, 


(1 1 


2 l'] 


u =0.216507. 


V3 9 ) 


U 9 J 


( ii ) We have X = 1/4, h = 1/3, k = Xh 2 = 1/36. The computations are to be done for four time steps, 
that is, upto t = 1/9. For X = 1/4, we get the method 

u i J+1 = ^ (u M j + 2u i j + u i+1J ), j = 0, 1, 2, 3 ; i = 1, 2. 

We have the following values. 

= 0.25(u 0>0 + 2 u lfi + u 2fi ) = 0.25[0 + 3(0.866025)] = 0.649519. 

= 0.25(u 1>0 + 2 u 2fi + u 3fi ) = 0.25[3(0.866025) + 0] = 0.649519. 

+• u 21 ) = 0.25[0 + 3(0.649519)] = 0.487139. 

4* u 31 ) = 0.25[3(0.649519) + 0] = 0.487139. 

= 0.25(m 02 + 2u 12 + u 22 ) = 0.25[0 + 3(0.487139)] = 0.365354. 

+ u 32 ) = 0.25 [3(0.487139) + 0] = 0.365354. 

+ u 23 ) = 0.25[0 + 3(0.365354)] = 0.274016. 

+■ u 33 ) = 0.25[3(0.365354) + 0] = 0.274016. 

After four steps t = 4k = 1/9. Hence, 


For j = 0: i = 1: 

u lx = 0.25(u 00 + 2 a.. 

i = 2: 

u 21 = 0.25 (u 10 + 2 

For j = 1: i = 1: 

u 12 = 0.25(w 01 + 2 

i = 2: 

u 22 = 0.250^ 1 + 2 

For j = 2: i = 1: 

u 13 = 0.25 (u 02 + 2 u-. 

i = 2: 

u 23 = 0.25 (u 12 + 2 

For j = 3: i = 1: 

w 14 = 0.25 (m 03 + 2a-, 

i = 2: 

m 24 = 0.25(u 13 + 2ur 


u = 0-274016, 

(iii) We have X = 1/6, h = 1/3, k = Xh 2 = 1/54. The computations are to be done for six time steps, 
that is, upto t = 1/9. For X = 1/6, we get the method 

u U+i = ^ (“j-ij + 4m u + u i+ 1,?’ J = 0, 1, 2, 3, 4, 5 ; i = 1, 2. 

We have the following values. 

For j = 0:1 si: u lt = | (u 00 + 4 u 10 + u 2fi ) = | [0 + 5(0.866025)] = 0.721688. 

i = 2: u 2 1 = ^ (Ui o + 4 u 2 0 + u 3 0 ) = ^ [5(0.866025) + 0] = 0.721688. 

For j = 1: $ = 1: u 12 = | (u 01 + 4u xx + u 21 ) = | [0 + 5(0.721688)] = 0.601407. 


i = 2: 


(u a i + 4 u 21 + u 31 ) = - [5(0.721688) + 0] = 0.601407. 
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For j = 2: i = 1: u 13 = — (u 02 + 4u 12 + u 22 ) 

i = 2: u 23 = — (u 12 + 4u 22 + u 32 ) 

For j - 3: i = 1: u 14 = — (u 0 3 + 4u 13 + u 23 ) 

i = 2: u 24 = — (u 13 + 4u 23 + u 33 ) 

For j = 4: i = 1: u 15 = — (u 0 4 + 4u 14 + a 2 4 ) 

i = 2: u 25 = — (u 14 + 4 u 2i + u 3 4 ) 

For j = 5: i = 1: u 16 = | (« 0 5 + 4u 15 + u 2 5 ) 

i = 2: u 2 6 = — (u 15 + 4a 2 5 + u 35 ) 

After six steps t = 6k = 1/9. Hence, 


| [0 + 5(0.601407)] = 0.501173. 
| [5(0.601407) + 0] = 0.501173. 
| [0 + 5(0.501173)] = 0.417644. 
| [5(0.501173) + 0] = 0.417644. 
| [0 + 5(0.417644)] = 0.348037. 
| [5(0.417644) + 0] = 0.348037. 
| [0 + 5(0.348037)] = 0.290031. 
| [5(0.348037) + 0] = 0.290031. 


“ (I ’ = “ (I ’ " °- 290031 - 

The magnitudes of errors at x = 1/3 and at x = 2/3 are same. The exact solution at / = 1/9 is 



The magnitudes of errors are the following: 

)i=l/2: | 0.216507 - 0.289250 | = 0.072743. 

>i=l/4: | 0.274016 - 0.289250 | = 0.015234. 

>i=l/6: | 0.290031 - 0.289250 | = 0.000781. 

We note that the higher order method produced better results. 

Example 5.17 Solve = 32 u t , 0 <x < 1, taking h = 0.5 and 

u(x, 0) = 0, 0 <x < 1 , u(0, t ) = 0, u( 1 , t) = t, t > 0. 

Use an explicit method with X = 1/2. Compute for four time steps. 


Solution The given partial differential equation is 


1 _ 

32' 
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The step length is h = 0.25. We have five nodal 14 
points on each mesh line (see Fig.5.23). We are to find 

the solutions at three internal points. _ 

The Schmidt method is given by _ 

u i 7+i = ^ u i -1 j + (l - 2A)u^ j + ku i+1 j. - 

For A = 1/2, the method becomes - 

U i,M = °' 5 {u i-\j + 0 0.25 0 5 0.75-1 

j = 0, 1, 2, 3 ; i = 1, 2, 3. Fig. 5.23. Example 5.17. 

We have k = | (32) = L 

The initial condition gives the values u 0 0 = u 10 = u 20 = u 30 = u /l0 = 0. 

The boundary conditions give the values u Q ■ = 0, u 4 ■ = t- = jk = j, for all j. 

We obtain the following solutions. 


For j = 0: i = 1: 

u 41 = 0.5(w 00 + u 20 ) 

i = 0. 

i = 2: 

u 21 = 0.5(u 10 + u 30 ) 

i = 0. 

i = 3: 

u 31 = 0.5(w 20 + u 40 ) 

i = 0. 

For j = 1: i = 1: 

u 12 = 0.5(u 01 + u 21 ) 

i = 0.5(0 + 0) = 0. 

i = 2: 

u 22 = 0.5(1^ x + u 3 j) 

i = 0.5(0 + 0) = 0. 

i = 3: 

u 32 = 0.5 (w 21 + u 41 ) 

i = 0.5(0 + 1) = 0.5. 

For j = 2: i = 1: 

1^13 = 0.5(n 02 + u 22 ) 

i = 0.5(0 + 0) = 0. 

i = 2: 

u 23 = 0.5(m 12 + u 32 ) 

= 0.5(0 + 0.5) = 0.25. 

/ = 3: 

u 33 = 0.5 (u 22 + u 42 ) 

i = 0.5(0 + 2) = 1.0. 

For j = 3: i = 1: 

u 14 = 0.5(n 0 3 + u 2 _ 3 ) 

= 0.5(0 + 0.25) = 0.125. 

i = 2: 

u 2i = 0.5(m 13 + u 33 ) 

i = 0.5(0 + 1.0) = 0.5. 

/ = 3: 

u 34 = 0.5 (u 23 + u 43 ) 

= 0.5(0.25 + 3) = 1.625. 


The approximate solutions are u(0.25, 4) = 0.125, u (0.5, 4) = 0.5, w(0.75, 4) = 1.625. 

Implicit methods 

Explicit methods have the disadvantage that they have a stability condition on the mesh ratio 
parameter A. We have seen that the Schmidt method is stable for A < 0.5. This condition severely 
restricts the values that can be used for the step lengths h and k. In most practical problems, 
where the computation is to be done up to large value of t, these methods are not useful because 
the time taken is too high. In such cases, we use the implicit methods. We shall discuss the most 
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popular and useful method called the Crank-Nicolson method. There are a number of ways of 
deriving this method. We describe one of the simple ways. Denote V ; as the backward difference in 
the time direction. From Eq.(2.32), we write the relation 


du 


= - log (1- V t )u = V f + — Vj + — Vf + ... 


Now. approximate k | - [v, + i V?] u -u. 
If we expand the operator on the right hand side, we get 
V, 


(5.46) 

(5.47) 


- = V t 1--V t =V i l+ — V ( + — Vj + 


1- (1/2) V t 

which agrees with the first two terms on the right hand side of (5.46). Applying the differential 
equation at the nodal point ( i,j +1), (see Fig.5.24), we obtain 


(I). 


(5.48) 


Using the approximation given in (5.47) to left hand side and the central difference ap¬ 
proximation (5.39) to the right hand side, we obtain 


71^'F* 




4 


u i,j+l = f 8 * u i,j+l - \ 5 * { u iJ + 1 - “u}]> 


1 = 77 (Sv U; ;+ i + 8* U; .•), 


X s 2 X s 2 

~2 5x = Uij + 2 5 X u u 
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A, A 

u i,j+l ~ 2 ~ 2 u iJ + 1 + u i-\ j+ i) — Mfj + 2 (Mj+IJ _ + U i-L j?» 

— n U i-L 7+1 + (1 + A)Uj j + i — — Uj + 1 ; +1 = — Ui_i j + (1 — A )lli j+ u i+1 j 
2 * -47+1 I,J+i 2 i+ 4 7+i 2 1 ^ 2 


where A = kc 2 /h 2 . This method is called the Crank-Nicolson method. 
The nodal points that are used in the method are given in Fig.5.24. 


(5.50) 


1-1,1 + 1 

J 

( U + i 


i-i,i 



i + i,j 


1 


\ 


Level j + 1 

Level j 


Fig. 5.24. Nodes in Crank-Nicolson method. 

Remark 14 From the right hand side of Eq.(5.49), we note that it is the mean of the central 
difference approximations, 8* u , to the right hand side of the differential equation on the levels j 
and j + 1. This concept of taking the mean of the central difference approximations to the right 
hand side of a given differential equation is often generalized to more complicated differential 
equations. 

Remark 15 The order of the Crank-Nicolson method is 0{k 2 + h 2 ). 

Remark 16 Implicit methods often have very strong stability properties. Stability analysis of the 
Crank-Nicolson method shows that the method is stable for all values of the mesh ratio param¬ 
eter A. This implies that there is no restriction on the values of the mesh lengths h and k. 
Depending on the particular problem that is being solved, we may use sufficiently large values of 
the step lengths. Such methods are called unconditionally stable methods. 

Computational procedure The initial condition u(x, 0) - fix) gives the solution at all the nodal 
points on the initial line (level 0). The boundary conditions u(0, t) =g(t),u(l, t) -h(t),t > 0 give the 
solutions at all the nodal points on the lines x = 0 andx = l for all time levels. We choose a value 
for A and h. This gives the value of the time step length k. Alternately, we may choose the values 
for h and k. The difference equations at all nodal points on the first time level are written. This 
system of equations is solved to obtain the values at all the nodal points on this time level. The 
computations are repeated for the required number of steps. If we perform m steps of computa¬ 
tion, then we have computed the solutions up to time t m = mk. 

Remark 17 Do you recognize the system of equations that is obtained if we apply the Crank- 
Nicolson method ? Again, it is a tri-diagonal system of equations. It uses the three consecutive 
unknowns u t l j+1 , u t J+1 and u i+1 j+1 on the current time level. This is the advantage of the 
method. 

Let us illustrate the application of the method. 
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Example 5.18 Solve the equation u t = u xx subject to the conditions 

u(x, 0) = sin (n x), 0 <x < 1, u(0, t) = u( 1, t) = 0 
using the Crank-Nicolson method with, h = 1/3, k = 1/36. Do one time step. 

(A.U. Nov/Dec. 2006) 


Solution We have 


1 1 hr 2 1 1 

c2 ^' h -- S ’ k -m ’ x = T^ (9)= T (p ^ 25) - 

Crank-Nicolson method is given by 

X XX X 

- 2 “i-u+i + (1 + X)u iJ +1 - 2 Ui+X j+1 = 2 U ‘~ xi + (1 ~ X)UiJ + 2 Ui+1J 

For A = 1 / 4, we have the method as 

1 5 1 13 1 

- g Ui-u+l + ^ «i, j+1 - - U i+Xj+1 = - Ui _ xj + - Uij + - w i+1J 

or - Mj-ij+i + 10uj j +1 - u i+X j + 1 = + 6uj 7 - + u f+1 j, j = 0 ; Z = 1, 2. 

The initial condition gives the values 


u 00 = 0, u 1;0 = sin (ji/ 3) = (-s/3/2) = u 20 , u 30 = 0. 

The boundary conditions give the values u 0 j = 0 = u 3 ■ for all j, 

We have the following equations. 

Fory = 0, i = 1 : - u 0jl + 10 n 11 - u 21 = u 0fi + 6u lfi + u 2fi 

or 10u 11 -u 21 =— + — = —=6.06218. 

14 2>1 2 2 2 

i = 2: - u lx + 10u 21 - m 31 = u 10 + 6u 20 + u 30 

_ , ^ 6s/3 7-s/3 

or - u, , + 10n 9 , = u, n + 6u 9 n = — + —— = —— = 6.06218. 

1,1 2,1 1,0 2,0 o o O 


Subtracting the two equations, we get lli^ 1 - llu 21 
= 0. Hence, u 11 = u 2 v The solution is given by 


6.06218 

9 


= 0.67358. 


0 1/3 2/3 1 


Example 5.19 Solve u^ = u f in 0 < x < 2, t > 0, 


Fig. 5.25. Example 5.18. 


u{ 0, t) = u{2, t) = 0, t >0 and u{x, 0) = sin (n x/2), 0 <x < 2, 


using Ax = 0.5, At = 0.25 for one time step by Crank-Nicolson implicit finite difference method. 

(A.U Apr /May 2003) 










BOUNDARY VALUE PROBLEMS IN ORDINARY DIFFERENTIAL EQUATIONS... 


285 


Solution We have 


„ c At 0.25 

2 = 1, Ax = 0.5, At = 0.25, X = —5- =-= 1. 

’ ’ ’ Ax 2 0.25 


Crank-Nicolson implicit finite difference method is given by 


- — ; + i + (1 + X)ui j + i — — Uj + i ; + i — — Ui_i; + (1 — X)ui j + — Uj + i j. 

2 1 -U+J- L7+1 2 J+J ’- 7+1 2 ’ 7 ^ 2 J 


For X = \, we have the method as 


1 

2 


U i-lJ+l + 2 “i,7'+l 


1 _ 1 

2 U t+L i+i - 2 


1 

2“^' 


or 


- »M,M + J = 0 ; * - 1, 2, 3, 


The initial condition gives the values 


“o,o = °- «i, 0 = sin(ji/4) = (1/V2) = 0.70711, 

u 2fi = sin (n/2) = 1, u 3 0 = sin (3ji/4) = (1/^2) = 0.70711. 
The boundary conditions give the values u 0 • = 0 = u 4 for all j. 


0 0.5 1.0 1.5 2.0 

Fig. 5.26. Example 5.19. 


We have the following equations. 


For j = 0, t = l: - u 0 x x - u 2 x = u 00 + u 20 or Au 11 -u 21 =l, 

i = 2: - u 11 +4u 21 -u 31 = u 10 +u 30 or -u 11 + 4u 21 -u 31 = 1.41421, 

i = 3: — u 21 + 4u 31 —u 41 = u 20 + u 40 or - u 21 + 4u 31 = 1. 

Subtracting the first and third equations, we get 4u 11 - 4u 31 = 0. Hence, u 11 = u 3 r We 
have the system of equations as 

4 u 11 -u 21 = 1, and - 2 u x 1 + 4u 21 = 1.41421. 

Using determinants, the solution is obtained as 


Example 5.20 Solve by Crank-Nicolson method the equation u xx = u t subject to 
u(x, 0) = 0, u( 0, t) = 0 and u(l,t) = t, 


for two time steps. 


(A.U Nov/Dec. 2003, Nov/Dec. 2006) 
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Solution Since the values of the step lengths h and k are not given, let us assume h = 0.25 and 
X=l. Hence, k = Mi 2 = 0.0625. (Fig. 5.27). 

Crank-Nicolson implicit finite difference method is given by 

- \ “i-Jj+l + (1 + X)u U +1 " \ u i+x j +1 

= | “i-XJ +(1-Wuij + ^ Ui+1> j. 

For X = 1, we have the method as 0 0 25 0 5 °- 75 1 x 

1 , 0 1 1,1 Fig. 5.27. Example 5.20. 

- 2 u i-XJ*l + 2 u U +1 “ 2 Ui+1 ’ J +1 * 2 Ui ~ lj 2 “ 1+1J 

or - u t _ 1J+1 + 4 u i J+1 - u MJ+1 = Ui _ ld + u i+1J , j m 0 ; i = 1, 2, 3.. 


The initial condition gives the values 0 = 0 for all i. 

The boundary conditions give the values u 0 ■ = 0, for all j and u A ■- t- = jk = 0.0625 j. 
We have the following equations. 


For j = 0, i = 1 


- u 01 + 4 n 1 1 — u 21 = 

- u A1 + 4u 21 - u 31 = 

- u 21 + 4uoi - u 41 = 


4iii i - u 2;1 = 0, 

x + Au 2 a - u 3 x = 0, 

- u 21 + 4u 31 = 0.0625. 


The system of equations is given by 


4 

-1 

O' 

“1,1 


0 

- 1 

4 

- 1 

“2,1 

= 

0 

0 

-1 

4 

“3,1 


0.0625 


We solve this system by Gauss elimination. 


4 

-1 

O' 

0 


1 

-1/4 

0 1 

0 

-1 

4 

-1 

0 

, Perform , then R 0 + i?,. 

0 

15/4 

-1 

0 

0 

-1 

4 

0.0625 

4 2 1 

0 

-1 

4 | 0.0625 


ri 

- 1/4 

0 

1 0 1 

P 

1 

- 4/15 

0 

L° 

0 

56/15 

| 0 . 0625 J 


The second equation gives u 21 = u 31 = 0.01674 = 0.00446. 


The first equation gives u A1 = 


0.00446 = 0.00112. 
























BOUNDARY VALUE PROBLEMS IN ORDINARY DIFFERENTIAL EQUATIONS... 


287 


For j = 1, 

i = 1 : 

- u 0 2 + 4u 12 -u 22 = u 0l + u 2 

! = 0 + 0.00446, 

or 


4 u 1 2 — u 2 2 = 0.00446. 



i = 2: 

- u 12 + 4 u 2 2 -u 32 = u 11 + u 31 

= 0.00112 + 0.01674 = 0.01786. 


i = 3: 

-U 2 2 + 4 U 3 2 - 2 = U 2 1 + U A 1 

= 0.00446 + 0, 


or - u 22 + 4 u 3 2 = 0.00446 + 0.125 = 0.12946. 

The system of equations is given by 


1 

4 

-°>1 

“1,2 

“2,2 

= 1 

[0.00446] 

0.01786 

1 


“3,2 


[o. 12946 J 


We solve this system by Gauss elimination. 


4 

-1 

0 

1 0.00446' 

i?l 

[1-1/4 

0 

1 0.001115] 

-1 

4 

-1 

0.01786 

. Perform — , then R 2 + R r 

0 15/4 

-1 

0.018975 . 

0 

-1 

4 

0.12946 


[o -1 

4 

0.12946J 


Perform 


R 2 

(15/4) 


, then R 3 + R 2 . 


'1 

-1/4 

0 

1 0.001115" 

0 

1 

-4/15 

0.00506 

0 

0 

56/15 

0.13452 


The last equation gives u 3 2 = 


© 


0.13452 = 0.036032. 


The second equation gives u 2 2 = j u 3 2 = |^^-j 0.036032 = 0.014669. 
The first equation gives u 1 2 = j “2,2 = j 0.014669 = 0.004782. 


- ( REVIEW QUESTIONS j - 

1. Write the one dimensional heat conduction equation and the associated conditions. 
Solution The heat conduction equation is given by 
u t = c2u xx’ 0 ^ x < l, t > 0. 

The associated conditions are the following. 

Initial condition At time / = 0, the temperature is prescribed, u(x, 0) = fix), 0 < x < l. 
Boundary conditions Since the bar is of length l, boundary conditions at x = 0 and at 
x = l are to be prescribed. 

u(0, /) = g(t), u(l, t ) = h{t), t> 0. 
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2. What is an explicit method for solving the heat conduction equation? 

Solution In explicit methods, the solution at each nodal point on the current time level is 
obtained by simple computations (additions, subtractions, multiplications and divisions) 
using the solutions at the previous one or more levels. 

3. Write the Schmidt method for solving the one dimensional heat conduction equation. 
Solution The Schmidt method for solving the heat conduction equation 

U t = C ^ U xx’ 0^x<l,t>0 

is given by u t j+1 = j : + (1 - 2X)u i ■ + Xu i+1 j; j = 0, 1, .... ; i = 1,2, ... 

where X = kc 2 !h 2 , is the mesh ratio parameter and h and k are the step lengths in the x 

and t directions respectively. 

4. What is the order and truncation error of the Schmidt method? 

Solution The order of the method is 0(k + h 2 ). For a fixed value of^, the method behaves 
like an 0(h 2 ) method. The truncation error of the method is given by 

5. Write the Bender-Schmidt method for solving the one dimensional heat conduction equa¬ 
tion. 

Solution The Bender-Schmidt method for solving the heat conduction equation 
U t = C ^ U xx' 0^x<l,t>0 

is given by u t j+1 = ^ (u i :L ■ + u i+1 J). This method is a particular case of the Schmidt 
method in which we use the value X = 1/2. 

6. Write the particular case of the Schmidt method which is of order 0(k 2 + h 4 ). 

Solution The higher order 0(k 2 + h 4 ) method is obtained by setting X = 1/6 in the Schmidt 
method. The method is given by 

u ij *i = e [u i~XJ + 4u U + “wJ* 

For a fixed value of X, the method behaves like an Oih 4 ) method. 

7. When do we call a numerical method as stable? 

Solution A numerical method is said to be stable when the cumulative effect of all errors 
tend to zero as the computation progresses. 

8. What is the condition of stability for the Schmidt method? 

Solution Schmidt method is stable when the mesh ratio parameter X satisfies the condi¬ 
tion X < 1/2. 

9. Is the Bender-Schmidt method for solving the heat conduction equation stable? 

Solution The Bender-Schmidt method is obtained from the Schmidt method by setting 
X = 1/2. Schmidt method is stable when the mesh ratio parameter^, satisfies the condition 
X < 1/2. Hence, Bender-Schmidt method is also stable. 



BOUNDARY VALUE PROBLEMS IN ORDINARY DIFFERENTIAL EQUATIONS... 


289 


10. Define an implicit method for solving the heat conduction equation. 

Solution In implicit methods, we solve a linear system of algebraic equations for all the 
unknowns on any mesh line t = t j+v 

11. Define two level and three level methods. 

Solution When a method uses the nodal values on two time levels t- and t j+1 , then it is 
called a two level formula. When a method uses the nodal values on three time levels 
tj_ v tj and t j+v then it is called a three level formula. 

12. Write the Crank-Nicolson method for solving the one dimensional heat conduction 
equation. 

Solution The Crank-Nicolson method for solving the one dimensional heat conduction 
equation u t = c 2 u xx , 0 < x < l, t > 0, is given by 


or 


I* 

X, 

2 Ui+ 




-1,7 + d - W UiJ + 


A. 

2 Ui+1J 


where X = kc 2 !h 2 , is the mesh ratio parameter and h and k are the step lengths in the x 
and t directions respectively. 

13. What is the order of the Crank-Nicolson method for solving the heat conduction equation? 
Solution The order of the Crank-Nicolson method is 0(k 2 + h 2 ). 

14. What is the condition of stability for the Crank-Nicolson method? 

Solution The Crank-Nicolson method is stable for all values of the mesh ratio parameter 
X. The method is also called an unconditionally stable method. 

15. What type of system of equations do we get when we apply the Crank-Nicolson method to 
solve the one dimensional heat conduction equation? 

Solution We obtain a linear tridiagonal system of algebraic equations. 


- ( EXERCISE 5.4 ) - 

1. Solve u t = u X5C , 0 < x < l,with u(x, 0) = x(l - x), 0 < x < 1 and u( 0, t) = u( 1, t) = 0 for all 
t > 0. Use explicit method with h = 0.25 and X = 0.25. Compute for four time steps. 

2. Solve u xx = 16^, 0 <x < l,with u{x, 0) = x(l - x), 0 < x < 1 and u( 0, t ) = u( 1, t) = 0 for all 
t > 0. Use Schmidt method with h = 0.25 and X = 1/6. Compute for four time steps. 

3. Solve u^ = Au t , 0 <x < 1, with u(x, 0) = 2x for* e [0, 1/2] and 2(1 -x) for* e [1/2, 1]; and 
u(0,t ) =u(l,t) = Ofor all/> 0. Use Schmidt method with h = 0.25 andA= 0.5. Compute for 
four time steps. 

4. Solve the heat conduction equation u t = u xx , 0 < x < 1 , with u(x, 0) = sin(2jr x) , 0 < x < 1, and 
u(0, t) = n(l, /) = 0 using the Schmidt method. Assume h = 0.25. Compute with 
(i) X = 1/2 for two time steps, (ii) X = 1/4 for four time steps, (iii) X = 1/6 for six time steps. 
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5. Solve u t = u^, 0<x<5,t>0, given that u(x, 0) = 20, u{ 0, t) = 0, u{ 5, t ) = 100. Compute u 

for one time step with h = 1, by Crank-Nicolson method. (A. U Apr I May 2005 ) 

6. Solve the heat equation u t = u xx , 0 < x < 1, subject to the initial and boundary conditions 

u(x, 0) = sin (ji x), 0 < x < 1, u( 0, t ) = u( 1, t) = 0 
using the Crank-Nicolson method with, h = 1/3, X = 1/6. Integrate for one time step. Find 
the maximum absolute error if the exact solution is u(x, t) = exp(- n 2 1) sin (roc). 

7. Find the solution of the equation u t = u xx , subject to the conditions 

u(x, 0) = 6x, for x e [0, 1] and 6(2 - x), x e [1, 2], u( 0, t) = 0 = u(2, t ) 
using the Crank-Nicolson method with h = 0.4, X = 1/2. Integrate for one time step. 

8. Solve the heat equation u t = u xx , 0 < x < 1, subject to the initial and boundary conditions 

u(x, 0) = sin (2 n x), 0 < x < 1, u( 0, /) = u( 1, /) = 0 
using the Crank-Nicolson method with, h = 0.25, X = 0.8. Integrate for two time steps. 
If the exact solution of the problem is u(x, t) = exp(- 4 n 2 1) sin (2rac), find the magnitudes of 
the errors on the second time step. 

9. Find the solution of the equation 16^ = u t , 0 < x < 1 subject to the conditions 

u(x, 0) = 1 - x, for 0 < x <, 1, u( 0, t) = 1-t, u( 1, /) = 0 
using the Crank-Nicolson method with h = 0.25, X = 1/2. Integrate for two time steps. 

10. Find the solution of the equation 4 u t = u xx , 0 < x < 1 subject to the conditions 
u{x, 0) = 3ce, for x e [0, 1/2] and 3(1 - x), xe [1/2, 1], u( 0, /) = 0 = u(l, t) 
using the Crank-Nicolson method with h = 0.25, k = 1/32. Integrate for two time steps. 

5.6 FINITE DIFFERENCE METHOD FORWAVE EQUATION 

In section 5.3, we have defined the linear second order partial differential equation 
Au xx + 2Bu xy + Cxiyy + Du x + Eiiy + Fu + G = 0 

as an hyperbolic equation ifS 2 -AC > 0. An hyperbolic equation holds in an open domain or in a 
semi-open domain. The simplest example of an hyperbolic equation is the one dimensional wave 
equation. 

Study of the behavior of waves is one of the important areas in engineering. All vibration 
problems are governed by wave equations. 

Consider the problem of a vibrating elastic string of length l, located on the x-axis on the 
interval [0, /]. Let u(x,t) denote the displacement of the string in the vertical plane. Then, the 
vibrations of the elastic string is governed by the one dimensional wave equation 

u tt = c 2 ^, 0 < x < l, t > 0. (5.51) 

where c 2 is a constant and depends on the material properties of the string, the tension T in the 
string and the mass per unit length of the string. 

In order that the solution of the problem exists and is unique, we need to prescribe the 
following conditions. 
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( i) Initial condition Displacement at time t = 0 or initial displacement is given by 
u(x, 0) = fix), 0 <x<l. 

Initial velocity: u t (x, 0) = g(x), 0 <x<l. 


(5.52 a) 
(5.53 b) 


(ii) Boundary conditions ^e consider the case when the ends of the string are fixed. Since 
the ends are fixed, we have the boundary conditions as 


u{ 0, t) = 0, u{l, t) = 0, t > 0. 


(5.53) 


Since both the initial and boundary conditions are prescribed, the problem is called an initial 
boundary value problem. 

Mesh generation The mesh is generated as in the case of the heat conduction equation. Super¬ 
impose on the region 0<x<l,t>0,& rectangular network of mesh lines. Let the interval [0, l] be 
divided into M parts. Then, the mesh length along the x-axis is h = UM. The points along the x- 
axis areXj = ih, i = 0, 1,2,..., M. Let the mesh length along the Laxis be k and define t - = jk. The 
mesh points are (x t , tj) as given in Fig. 5.20. We call t -as thejth time level. At any point (x., tj), 

we denote the numerical solution by and the exact solution by u{x i , tj). 

As in the case of the heat conduction equation, we can derive explicit and implicit methods 
for the solution of the wave equation. 

Let us derive a few methods. 

Explicit methods 

Using central differences, we write the approximations 



(5.54) 


(5.55) 


Applying the differential equation (5.51) at the nodal point (x t , t), and using the central 
difference approximations, (5.54), (5.55), we get 


or 


or 



or u i,j+i = 2(1- r 2 )uij + r 2 [u i+1 j + - u ij _ 1 

where r = kc/h, is called the mesh ratio parameter. 

The nodes that are used in the computations are given in Fig.5.28. 


(5.56) 
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tj + 1 


l-1-j 

/ 

j,\ 

j + i,j 







i,i-i 



Level j +1 


Level j 
Level j -1 


Fig. 5.28. Nodes in explicit method. 

Remark 18 We note that the minimum number of levels required for any method (explicit or 
implicit) is three. Therefore, the method is always a three level method. The value u ■ j+1 at the 
node (x p t j+1 ) is being obtained by the formula in Eq. (5.56), explicitly using the values on the 
previous time levels t- and t-_ v 

Truncation error of the explicit method 

We have the method as 


f+1 - 2 Ujj + Uij-i 


k + i 


-2u, . 


ij]. 


Expanding in Taylor’s series, we obtain 

u(Xj, tj + k) - 2u(x i , tj) + u(x it tj - k ) 


ii 7 3 u k l 3 l u 

= \ \u + k — +-s-- 

n dt 2 3 t 2 


kr 3 3 u k 4 3 4 u 
~6~dF + 24~dF^ 


-2 U + \u-k — + ■a-- b-+ 


k d 3 3 u , 
6 3 t s 


kr 3 4 u 
24 dt 4 ~ 


? 3 2 u k 4 3 4 u 
3 t 2 12 3 t 4 


r 2 [u(x i+1 , tj) - 2u(x i , tj) + u(x i V tj)] 


h 2 


k 2 c 2 

'hF 


. 3 u h 2 3 2 u h 3 3 3 u h 4 3 4 m 

U + h -+- tt+ - 5 -+-— 4 

dx 2 dx 2 6 dx 3 24 dx 4 


i du | h l 3 u h 3 3 3 u | hr 3 4 u 
dx 2 dx 2 6 3x 3 24 dx 4 


' I r 

3x 2 12 3x 4 J [ 


d 2 u h 2 3 4 u 

-o~ “I-7" 

3x 2 12 3x 4 


where all the terms on the right hand sides are evaluated at (x p tj. The truncation error is given 

by 
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T.E = [uix^ tj + k) - 2u(x i , tj ) + u(x i , tj - k)\ - r 2 [u(x i+v tj) - 2u{x i , tj) + u{x i V tj)] 
2 9 2 “ . 


2 au 

dt 2 


= + ^ 


k 4 d 4 u 

12 


* V| *5?*F 

2|— _ 2 — 1 -v „ - k 2 h 2 C 2 d 4 u 
- k \ C 3r 2 L19 12 ;w 4 


h 2 d 4 u | 

12 a* 4 + 


Now, using the differential equation 
2 d 2 n 


d 2 u _ 


d 4 u 

-and -T- - 

Dx 2 dt 4 


i d 4 u 
dx 4 


T.E. = 


k 4 c 4 d 4 u 
12 dx 4 


since A = ( hr)/c. 


k 2 h 2 c 2 d 4 u 
12 dx 4 


k 2 h 2 c- 

12 


0 r 2 - 1 ) 



(5.57) 


The order of the method is given by- 

order = \ (T.E) = 0(A 2 + k 2 ). (5.58) 

k 

Remark 19 For a fixed value ofr, that is, r = Ac/A = fixed, we have A = rA/c or A = Oih). Hence, for 
a fixed value ofr, the method is of order Oih 2 ). That is, the values of A and A are reduced such that 
the value of r is always same. 

Remark 20 For r = 1, the leading term in the error expression given in (5.57) vanishes. Hence, 
the truncation error of the method is of the order 0(A 6 + A 2 A 4 ). The order of the method is 
0(A 4 + A 4 ). Therefore, for the fixed value of r = 1, the method is of order 0(A 4 ). The higher order 
method obtained when r = 1 is given by 

«k/+1 - 2u i,j + u i, j -1 = “i+u - 2u u + u i-%j 
or u i,j+l = 2u i,j - u i,j -1 + [“irJJ _ 2u iJ + u i-\j 1 

= u i+ -^j + Ui_^j - Uij _ x . (5.59) 

The nodes that are used in computations are given in Fig. 5.29. 




i. j + 1 


i-i.i 



\ +1, j 







N,j-i 



- Level j + 1 

- Level j 

- Level j - 1 


Fig. 5.59. Nodes in explicit method for r= 1. 
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When the values of h and k are not prescribed in any particular problem, we may choose 
these values such that r = 1. 

Remark 21 In the case of the wave equation also, stability of the numerical computations 
plays an important role. Analysis of the method gives that the method is stable if 



Note that the higher order method (5.59) uses the value r = 1. Hence, the higher order 
method is also stable. 

Computational procedure 

Since the explicit method (5.56) or (5.59) is of three levels, we need data on two time levels t = 
0 and t = k, to start computations. 

The boundary conditions ui 0, t) = git), uil, t ) = hit), t > 0 give the solutions at all the 
nodal points on the lines x = 0 and x = l for all time levels. We choose a value for k and h. This 
gives the value of r. Alternately, we may choose the values for h and r. For r = 1, and c = 1, we 
have h = k. 

The initial condition u{x, 0) = fix) gives the solution at all the nodal points on the initial 
line (level 0). The values required on the level t = k is obtained by writing a suitable approxi¬ 
mation to the initial condition 

^ (x, 0) = g(x). 
at 

If we write the central difference approximation, we obtain 

^(x,0 )~^[u il -u i _ 1 ] = g(x i ). (5.61) 

dt 2k 

This approximation introduces the external points u t v Solving for u i from (5.61), we get 
u i -l = u i l - 2 kgiXj). (5.62) 

Now, we use the method (5.56) or (5.59) at the nodes on the level t = k, that is, for j = 0. 
We get 

u i X = 2(1- r 2 )u i0 + r 2 [n i+li0 + u ; _ 10 ] - m h , (5.63 a) 

The external points u i ~\, that are introduced in this equation are eliminated by using 
the relation in (5.62). 

u i X = 2(1 - r 2 )u i 0 + r 2 [u i+X0 + - [u t l - 2&g(xj)] 

or 2 u t 1 = 2(1 - r 2 )u t 0 + r 2 [u i+xo + Mj^o] + 2kg(Xi). (5.63 b ) 

This gives the values at all nodal points on the level t - k. 

For example, if the initial condition is prescribed as — (x, 0) = 0, then we get from 

dt 

(5.62), u t _ x = u i v The formula (5.63b) becomes 
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or 


2 u i X = 2(1 - r 2 )u i 0 + r 2 [ u i+10 + 
u i,i= 0- - r2 Ko + y [Ui+1 ’° + 


(5.64) 


For r = 1, the method simplifies to 



(5.65) 


Thus, the solutions at all nodal points on level 1 are obtained. For t > k, that is for j > 1, 
we use the method (5.56) or (5.59). The computations are repeated for the required number of 
steps. If we perform m steps of computation, then we have computed the solutions up to time 

t m = m k- 

Let us illustrate the method through some problems. 

Example 5.21 Solve the wave equation 


u tt = u xx> 0 < 1, subject to the conditions 

u(x, 0) = sin (n x), u t (x, 0) = 0, 0 <x < 1, u(0, t ) = u( 1, t) = 0, t > 0 


using the explicit method with h = 1/4 and (i) k = 1/8, (ii) k = 1/4. Compute for four time steps for 
(i), and two time steps for (ii). If the exact solution is u(x, t) = cos (k t) sin (k x), compare the 
solutions at times t = 1/4 and t = 1/2. 

Solution The explicit method is given by 


u iJ+ i = 2(1 - r 2 )u u + r 2 [u i+1] + u^J - Ui j _ r 


We are given c = 1 and h = 1/4. Hence, we have five nodes on each time level (see 
Fig.5.30). We have to find the solution at three interior points. 

The initial conditions give the values 

(а) u i0 = sin (i n/4), i = 0, 1, 2, 3, 4 

“o,o = °> “ 1,0 = sin = = 0.70711, u 2fi = sin (ji/2) = 1, 

u 3fi = sin (3 tc/4) = (1/V2) = 0.70711, u 40 = sin (rc) = 0. 

(б) upc, 0) = 0 gives u ■ = u t v 

The boundary conditions give the values u 0 ■ = 0, u 4 ■ = 0, for all j. 

h ii t ▲ 

(i) When k = 1/8, we get r = — = — (4) = —. The method 
h 8 2 


becomes 



= 1.5^ j + 0.25 [u i+1 j + u t l J - u t j X , 
j = 0,1, 2, 3 ; / = 1, 2, 3. (5.66) 


(5.66) 


The computations are to be done for four time 


0 0.25 0.5 0.75 1.0 


steps, that is, up to / = 1/2 or j = 0, 1, 2, 3. 


Fig. 5.30. Example. 5.21. 













296 


NUMERICAL METHODS 


We have the following values. 

For j = 0 : Since upc, 0) = 0 we obtain u L _ 1 = u i v The method simplifies to 
u tl = 0.75w i0 + 0.125 [w i+10 + w il0 ]. 
i= 1: n 11 = 0.75n 10 + 0.125(u 20 + u 00 ) 

= 0.75(0.70711) + 0.125(1 + 0) = 0.65533. 
i = 2 : u 21 = 0.75u 20 + 0.125(m 30 + u 10 ) 

= 0.75 + 0.125(0.70711 + 0.70711) = 0.92678. 
i = 3: u 31 = 0.75u 30 + 0.125(u 40 + u 20 ) 

= 0.75(0.70711) + 0.125(0 + 1) = 0.65533. 

For j = 1: We use the formula (5.66). 

i= 1 : u 12 = 1.5 u 11 + 0.25 [u 21 + u 01 ] - u 10 

= 1.5(0.65533) + 0.25(0.92678 + 0) - 0.70711 = 0.50758. 
i = 2 : u 22 = 1.5 u 21 + 0.25[u 31 + u 1:L ] - u 20 

= 1.5(0.92678) + 0.25(0.65533 + 0.65533) - 1.0 = 0.71784. 
i = 3 : u 3 2 = 1.5u 3 1 + 0.25 [u A x + u 2 J - u 3 0 

= 1.5(0.65533) + 0.25(0 + 0.92678) - 0.70711 = 0.50758. 

For 7 = 2 : 

i = 1 : u i 3 = 1-5w 12 + 0.25 [u 2 2 + u 02 ] - u 11 

= 1.5(0.50758) + 0.25(0.71784 + 0) - 0.65533 = 0.28550. 
i = 2 : u 2 3 = 1.5u 22 + 0.25 [u 3 2 + u 12 ] - u 21 

= 1.5(0.71784) + 0.25(0.50788 + 0.50788) - 0.92678 = 0.40377. 
i = 3 : u 33 = 1.5 u 32 + 0.25 [u 4 2 + m 22 ] - u 31 

= 1.5(0.50758) + 0.25(0 + 0.717835) - 0.65538 = 0.28550. 

For j = 3: 

i = 1 : 4 = 1.5^! 3 + 0.25 [u 2 3 + u 03 ] - u 12 

= 1.5(0.285499) + 0.25(0.403765 + 0) - 0.50758 = 0.02161. 
i = 2 : u 24 = 1.5w 23 + 0.25[w 33 + w 13 ] - u 22 

= 1.5(0.4037625) + 0.25(2X0.285499) - 0.717835 = 0.03056. 
i = 3 : u 34 = 1.5w 33 + 0.25[w 43 + w 23 ] - m 32 

= 1.5(0.285499) + 0.25(0 + 0.40377) - 0.50758 = 0.02161. 
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k 1 

(; ii ) When k = 1/4, h = 1/4, we get f = — = — (4) = L The computations are to be done for two time 
h 4 

steps, that is, up to / = 1/2 or j = 0, 1. For r = 1, we get the method as 

“iJ+1 = U i-U + U i+U - U ij-u j = 0, 1 ; i = 1, 2, 3. (5.67) 

We have the following values. 

For j = 0 : u i l = u i v simplifies the method as 

u il = u i X 0 + u i+10 - u iV or u t x = 0.5 (u^ 0 + u i+10 ). 
i = 1 : Mu = 0.5(u 00 + u 20 ) = 0.5[0 + 1] = 0.5. 

i = 2 : u 21 = 0.5(w 10 + u 3fi ) = 0.5(2X0.70711) = 0.70711. 

i = 3 : u 3 i = 0.5 (u 20 + u 40 ) = 0.5(1 + 0) = 0.5. 

For j = l: We use the formula (5.67). 

i = 1 : u 12 = u 01 + u 21 - u 10 = 0 + 0.70711 - 0.70711 = 0.0 

i = 2 : u 2 2 = u 11 + u 3 x - u 2 0 = 0.5 + 0.5 - 1.0 = 0.0. 

i = 3 : u 32 = u 21 + u A1 - u 3fi = 0.70711 + 0 - 0.70711 = 0.0. 

The exact solution and the magnitudes of errors are as follows: 

At t = 0.25 : u(0.25, 0.25) = u(0.75, 0.25) = 0.5, u(0.5, 0.25) = 0.70711. 

For r = 1/2: The magnitudes of errors are the following: 

| u(0.25, 0.25) - u 12 1 = | 0.50758-0.5 | =0.00758, 

| u(0.5, 0.25) - u 2 2 | = | 0.717835 - 0.70711 | = 0.0107, 

| u(0.75, 0.25) - u 3 2 | = | 0.50758 - 0.5 | = 0.00758. 

For r - 1, we obtain the exact solution. 

At t = 0.5 : u(0.25, 0.5) = it(0.75, 0.5) = it(0.5, 0.5) = 0.0. 

For r = 1/2 : The magnitudes of errors are 0.02161, 0.03056, and 0.02161. 

For r = 1, we obtain the exact solution. 

Example 5.22 Solve u tt = 4u xx , with boundary conditions u(0, t) = 0 = u(4, t), t > 0 and the 
initial conditions u t (x, 0) = 0, u(x, 0) = x(4 - x). 

(A. U., Nov / Dec 2006) 

Solution We have c 2 = 4. The values of the step 
lengths h and k are not prescribed. The number of 
time steps up to which the computations are to be 
performed is not prescribed. Therefore, let us assume 
that we use an explicit method with h = 1 and 
k = 0.5. Let the number of time steps up to which 
the computations are to be performed be 4. Then, 
we have 


1.0 2.0 3.0 4.0 

Fig. 5.31. Example 5.22. 
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ck _ 2(0.5) = 

A 1 

The explicit formula is given by (see (5.59)) 

“U+i = “i+U + “i-W “ “ij-i, J = 0, 1, 2, 3 ; i - 1, 2, 3. (5.68) 

The boundary conditions give the values u 0 = 0, u 4 = 0, for all j (see Fig. 5.31). 

The initial conditions give the following values. 

u(x, 0) = x(4 - x), gives u 00 = 0, u 10 = u{ 1, 0) = 3, 
u 20 = u{ 2, 0) = 4, u 30 = u( 3, 0) = 3, u 40 = u( 4, 0) = 0. 

Central difference approximation to u t (x, 0) = 0 gives u t _ 4 = u L 
We have the following results. 

For j = 0: Since, u t 4 = u, v the formula simplifies to u t 4 = 0.5(u i+1 0 + u i X 0 ). 


= 1 : 

u 41 = 0.5 {u 2 

0 + u 00 ) = 0.5(4 + 0) = 2, 

= 2 : 

u 21 = 0.5 (u 3 

0 + u 10 ) = 0.5(3 + 3) = 3, 

= 3: 

u 31 = 0.5 (u 4 

0 + u 2fi ) = 0.5(0 + 4) = 2. 


These are the solutions at the interior points on the time level t = 0.5. 

For j = 1: We use the formula (5.68), to give u i2 = u i+1 x + u i X 1 -u i 0 . 
i = 1: u 12 = n 21 + ii 01 -ii 10 = 3 + 0- 3 = 0, 

i = 2: u 22 = u 31 + u 11 - u 20 = 2 +2 - 4 = 0, 

i = 3: u 32 = u 41 + u 21 - u 30 = 0 + 3- 3 = 0. 

These are the solutions at the interior points on the time level t = 1.0. 

For j = 2: We use the formula (5.68), to give u i3 = u i+12 + u i X 2 - u ■ 1 . 

i = 1 : m 13 = u 22 + u 02 -m 11 = 0 + 0-2 = -2, 

i = 2: u 23 = u 32 +u 12 -u 21 = 0 + 0-3 = -3, 

i = 3: u 33 = u 42 +u 22 -u 31 = 0 + 0-2 = -2. 

These are the solutions at the interior points on the time level t = 1.5. 

For j = 3: We use the formula (5.68), to give u i4 = u i+1 3 + u i X 3 -u i2 . 

i = 1: u 14 = u 23 + u 03 - u 12 = - 3 + 0 - 0 = - 3, 

i = 2: u 24 = u 33 + u 13 - u 22 = - 2-2-0 = -4, 

i = 3: u 3 4 = u 43 + u 23 - u 32 = 0-3-0 = -3. 

These are the solutions at the interior points on the required fourth time level t = 2.0. 

Example 5.23 Solve u xx = u tt , 0 < x < 1, t > 0, given u(x, 0) = 0, upc, 0) = 0, u(0, t) = 0 and 
u( 1, t) = 100 sin (k t). Compute for four time steps with h = 0.25. (A. If. Nov/Dec. 2003) 
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Solution We have c = 1 and h = 0.25, (see Fig. 5.30). The value of the step length k is not 
prescribed. Since the method is not specified, we use an explicit method. 

We assume k = 0.25 so that r = 1. The method is given by 

u iJ+ 1 = u i+1J + u^j - UiJ _ x , j = 0, 1, 2, 3; i = 1, 2, 3. 

The boundary conditions give the values 

u 0 j = 0, for all j, and u A . = 100 sin (n jk) = 100 sin (n j/4). 

That is, u 4fi = 0, u 4 x = 100 sin (jc/4) = (100/^) = 50 ^2 , 

u 42 = 100 sin (n/2) = 100, 

u i3 = 100 sin (3 tc/ 4) = (100/^2) = 50^2, u 44 = 100 sin (n) = 0. 

For j = 0: Since, u t _ x = u ■ 1 , the formula simplifies to u tl = 0.5(it i+10 + 10 ). 


= 1: 

u xl = 0.5(w 2 

o + u oc 

,) = 0.5(0 + 0) = 0, 

= 2: 

u 21 = 0.5 (u 3 

0 + “l,C 

,) = 0.5(0 + 0) = 0 

= 3: 

u 31 = 0.5 (u 4 

0 + U 2C 

,) = 0.5(0 + 0) = 0. 


These are the solutions at the interior points on the time level t = 0.25. 

For j = 1: We use the formula (5.68), to give u i2 = u i+1 1 + u i X x - u t 0 
i = 1: u 12 = u 21 + u 01 - u 10 = 0, 

i = 2: u 22 = u 31 + u xl — u 20 = 0, 

i = 3: u 32 = u 41 + u 21 - u 30 = 50-J2 +0-0 = 50-j2. 

These are the solutions at the interior points on the time level t = 0.5. 

For j = 2: We use the formula (5.68), to give u i3 = u i+12 + u i X2 ~ u iv 
i= 1: u 13 = u 22 + u 02 -u xl = 0 + 0 + 0 = 0, 

i = 2: u 23 = u 32 + u 12 - u 21 = 50-J2 + 0-0 = 50V2, 

i = 3: u 33 = u 42 + u 22 - u 31 = 100 + 0 - 0 = 100. 

These are the solutions at the interior points on the time level t = 0.75. 

For j = 3: We use the formula (5.68), to give u■ 4 = u i+13 + u i X3 -u i2 . 

i = 1: u 1A = u 23 + u 03 - u 12 = 50-J2 + 0 - 0 = 50V2, 

i = 2: u 24 = u 33 + u 13 - u 22 = 100 + 0 - 0 = 100, 

i = 3: u 34 = u 43 + u 23 - u 32 = 50V2 + 50V2 - 50-\/2 = 50-\/2 . 

These are the solutions at the interior points on the required fourth time level t = 1.0. 
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Implicit methods 


Explicit methods have the disadvantage that they have a stability condition on the mesh ratio 
parameter r = ( ck)/h. Explicit methods are stable for r < 1.0. This condition restricts the values 
that can be used for the step lengths h and k. In most practical problems, where the computa¬ 
tion is to be done up to a large value of t, these methods are not useful because the time 
consumed is too high. In such cases, we use the implicit methods. We derive the following two 
implicit methods. 

( i ) We write the following approximations at (x t , t). 



(5.69) 



1 

2 h 2 




(5.70) 


Hence, the difference approximation to the wave equation at the node {x t , tj) is given by 


or u iJ+ 1 - 2 UiJ + u K = r — [6* u i>M + 5* ] 

or u ij ^- r —hl u ij+1 = 2u u _ 1 -u i j_ 1 + r —h 2 x u i j_ 1 . (5.72) 

where r = (kc/h). We can expand the central differences and write 

u ij+i = u i+ij+i ~ 2 u ij+i + > 

1 = u i+l,j-i ~ 2u ij-l + ■ 

We get 

- Y^i+u+i +d+ r*yuij +1 - y u i- xm * 2u u + y _ (1 + r 2 )u i, j~i + y Ui ~ x j ~ v ’ 

The nodal points that are used in the method are given in Fig.5.32. 


i-1,j + 1 


,i.i + 1 

i + 1,j 



j.j 






-1. j-1 > 


M,j-1 ' 

n + i.j 


Fig. 5.32. Nodes in implicit method (5.72). 
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Remark 22 Using Taylor series expansions, we can show that the truncation error of the 
method given in Eq.(5.72) is 0{k 4 + k 2 h 2 ). Hence, the order of the method is Oik 2 + h 2 ). 

(ii) We use the approximation (5.69) for ^-4r, and the following approximation for . 


3 


The difference approximation to the wave equation at the node (x t , tj) is given by 


0r °t U i,j ~ [ u i,j+l ~ u i,j + 

or u i,j +1 — ^ u i,j + u i,j -1 =r2 [^x u i,j +1 ~~ 8 x u i,j + &x u i,j -ll 

or u iJ+ 1 -r 2 8 2 u l J+1 = 2 u t j - u -r 2 5 2 + r 2 8 2 ^ 

where r = (kc/h). We can expand the central differences and write 


(5.73) 


(5.74) 


8 2 U-iJ+l = u i+l,j+l - 2u iJ +1 + 8 2 Uij^ = 

The nodal points that are used in the method are given in Fig.5.33. 

Remark 23 Using Taylor series expansions, we can show that the truncation error of the 
method given in Eq.(5.73) is again of order 0{k 4 + k 2 h 2 ). Hence, the order of the method is 
Oik 2 + h 2 ). 

Remark 24 Implicit methods often have very strong stability properties. Stability analysis of 
the above implicit methods (5.72) and (5.74) shows that the methods are stable for all values 
of the mesh ratio parameter r ■ Hence, the methods are unconditionally stable. This implies 
that there is no restriction on the values of the mesh lengths h and k. Depending on the 
particular problem that is being solved, we may use sufficiently large values of the step lengths. 


I-1.J +1^ 


M" s 

i + 1, j + 1 | 0X/0 | j 

i-l.j 








i - 1. j - l' 


IjM 1 

n + hJ-f LeVeU 


Fig. 5.33. Nodes in implicit method (5.74). 
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Computational procedure 

The initial condition u{x, 0) = fix) gives the solution at all the nodal points on the initial line 
(level 0). The boundary conditions w(0, t) = g{t), u{l, t) = hit), t > 0 give the solutions at all the 
nodal points on the lines x = 0 and x = l for all time levels. We choose the values for k and h. 
This gives the value of the mesh ratio parameter r. Alternately, we may choose the values for 
r and h. 

On level 1, we use the same approximation as in the case of the explicit method, that is, we 
approximate 

u i_ i= u il -2kg(x i ). 

Now, we apply the finite difference method (5.72) or (5.74) on level 1. 

For example, consider the method given in (5.72). We obtain for j = 0, 



i-Sf = 2uj o - (u i ^ - 2kgi ) + — 8*(u^ - 2kgi ) 


or 2 u i X - r 2 lu i+ljl - 2 u t l + u ^y) = 2 u i 0 + 2kg t - kr 2 (g i+1 - 2g t + g t _i). (5.75) 

If the initial condition is, u t (x, 0) = 0, then the method simplifies as 

- r\_ xl + 2(1+ r 2 )u tl - r 2 u i+11 = 2u i>0 . (5.76) 

The right hand side in (5.75) or (5.76) is computed. For i = 1, 2,..., M - 1, we obtain a 
system of equations for u 1 v u 2 v ..., u M1 r This system of equations is solved to obtain the 
values at all the nodal points on the time level 1. For j > 0, we use the method (5.72) or (5.74) 
and solve a system of equations on each mesh line. The computations are repeated for the 
required number of steps. If we perform m steps of computation, then we have computed the 
solutions up to time t m = mk. 

Remark 25 Do you recognize the system of equations that is obtained on each time level ? 
Again, it is a tri-diagonal system of equations. It uses the three consecutive unknowns u i V j +1 , 
u i j +1 and u j+l j+1 on the current time level j + 1. 

Let us illustrate the application of the methods. 

Example 5.24 Solve the wave equation 

u u = u xx> 0 - x - L subject to the conditions 
u{x, 0) = sinln x), ufx, 0) = 0, 0 <x < 1, u{ 0, t) = u{\ t) = 0, t > 0. 

Use an implicit method with h = 1/4 and k = 1/4. Compute for two time levels. 

Solution We have 


1 

4 


,k = 


1 

4’ 


kc 

h 


1 

h 


(4) = 1. 


= 1 ,h = 


(Fig. 5.34). 
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For r = 1, we have the method (5.72) as 
. l = 2u iJ ~ u ij 

1 , 


1 ,2 


1 5:2 

i H-8* U: , 

1 2 * 


hj+1 


- (u i+ 


or - 0.5ui_^j +1 + 2uij +1 - 0.5wj +1 j +1 = 2u t j - 2Ujj_! + O.SCwj.jj^ + Mf+iJ-i) 

j = 0,1; i = 1, 2, 3. 

The boundary conditions give the values u 0 = 0 = u 4 for all j. 

The initial condition u(x, 0) = sin (n x), gives the values 
u 00 = 0, u 10 = sin(ji/4) = (1 /a/2), 
u 20 = sin(ji/2) = 1, 
u 30 = sin(3ji/4) = (1A/2 ), u 40 = 0. 

The initial condition u f {x, 0) = 0, gives the values 

u i_ i = u .j 

Therefore, for j = 0, we get the equation 
- 0.5 u i X 1 + 2 u i x - 0.5 u i+1 x 

= 2 u i0 - 2m._ x + 0.5(m^ + w. +li l ) 

or - u t l x + 4u ■ 1 - u i+1 x = 2 u t 0 . 

We have the following equations for j = 0. 

i = l: - u 01 + 4u 11 - u 21 = 2u 10 

or 4u 1(1 - u 21 = 2 = 42 = 1.41421. 


1/4 2/4 3/4 1.0 

Fig. 5.34. Example. 5.24. 


i = 2: 
i = 3: 


- u 1 x + 4 u 2 x - m 3 x = 2 u 2 0 = 2. 

- u 2 x + 4 u 3 x - x = 2 u 3 o 


or - u 2)1 + 4m 31 = 2 f-Lj = a/2 = 1.41421. 

Subtracting the first and third equations, we get 4u 11 - 4 u 3 x = 0. Hence, u lx = u 3 - 
Therefore, we have the equations 

4u 11 -u 21 = 1.41421, and - 2 u 11 + 4u 2 x = 2. 

The solution is given by 
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For j > 0, we use the method (5.72). 

“w* - y 8 * Hi* i = K/ - + y *1 

or %j+x - y (Ki+u+i - 2u y + i + Ui _ x j+l ) 

2 

= 2 u i,j - u U~ l + Y ( “* + W-i ” 2 “W-i + • 

For j = 1, we get (with r = 1) 

i = 1: - 0.5u 0 2 + 2^ 2 - 0.5u 2 2 = 2u 11 - 2 u 10 + 0.5(u 2 0 + u 00 ) 

or 2u 12 - 0.5 u 2 2 = 2(0.54692) - 2(0.70711) + 0.5(1.0 + 0) + 0.5(0) = 0.17962. 

i = 2: - 0.5 u 12 + 2u 2 2 - 0.5 u 3 2 = 2u 2 1 - 2u 2 o + 0.5(u 3 0 + u x 0 ) 

= 2(0.77364) - 2 ( 1 ) + 0.5(2X0.70711) = 0.25403. 
i = 3: - 0 . 5 u 2 2 + 2u 32 - 0.5it 42 = 2 u 31 - 2 u 30 + 0.5(m 40 + u 20 ) 
or - 0.5u 2 2 + 2u 3 2 = 2(0.54692) - 2(0.70711) + 0.5(0 + 1.0) + 0.5(0) = 0.17962. 

Subtracting the first and third equations, we get 2u 12 - 2u 32 = 0. Hence, u 12 = u 32 . 
Therefore, we have the equations 

2u 12 - 0.5u 22 = 0.17962, and - u 12 + 2u 22 = 0.25403. 

The solution is given by 


- ( REVIEW QUESTIONS ) - 

1. Write the one dimensional wave equation governing the vibrations of an elastic string. 
Solution The one dimensional wave equation governing the vibrations of an elastic 
string is given by 

u tt = c 2 ^, 0 < x < l, t > 0. 

where c 2 depends on the material properties of the string, the tension T in the string 
and the mass per unit length of the string. 

2. Write an explicit method for solving the one dimensional wave equation 

u tt = c^u^, 0 < x < l, t > 0 . 

Solution An explicit method for solving the one dimensional wave equation is given 
by 

u ij+i = 2d - r 2 )u u + r 2 [u i+1J + - u tJ _ x , j = 0,1,2,..., i = 1,2,3,... 
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where r = ( kc)/h , and h and k are step lengths in the x direction and t directions 
respectively. 

3. What is the order and truncation error of the method given in Problem 2? 

Solution The order of the method is 0(k 2 + h 2 ). The truncation error is given by 

*wr 2 ^ j 

12 [ dx 4 J 

4. Write an explicit method for solving the one dimensional wave equation 

u tt = c 2 ^, 0 <x <1, t > 0 
when r = [{kc)lh\ = 1 . 

Solution The method is given by 


u i,j+l = u i+l,j + u i-\j - u i,j-l- 

5. For what values of r = [{kc)lh\ is the explicit method for the one dimensional wave 
equation stable? 

Solution The explicit method is stable for r < 1. 

6. For what values of X, the explicit method for solving the hyperbolic equation 


—tv = -4- is stable, where X = ? (A. TJ. Apr / May 2003 ) 

dx c dt Ax 

Solution For X < 1. 

7. What do you mean by error in error analysis? (A. U. Nov I Dec. 2003) 

Solution In error analysis, error means the truncation error of the method. We write 
the Taylor series expansions of all the terms in the method and simplify. The leading 
term of this series (the first non-vanishing term) is called the truncation error. 

8 . Write an implicit method for solving the one dimensional wave equation 

u tt = c 2 ^, 0 < x < l, t > 0 . 

Solution An implicit method is given by 


or 



2 

~ 2 ~ 


= 2 mj + T — u i+xj ^ - (1 +r 2 )u iJ _ 1 + T — Ui _ xhl 
j = 0, 1, 2, ...; i = 1, 2, 3, ... 

9. For what values of r = [(kc)/h\ is the implicit method for the one dimensional wave 
equation stable? 



306 


NUMERICAL METHODS 


Solution The implicit method is stable for all value of r, that is, the method is uncondi¬ 
tionally stable. 

10. What type of system of equations do we get when we apply the implicit method to solve 
the one dimensional wave equation? 

Solution We obtain a linear tridiagonal system of algebraic equations. It uses the 
three consecutive unknowns ii-_ lj+1 , u i j+1 and u i+1 j +1 on the current time level j + 1. 

- f EXERCISE 5.5 ) - 

1. Solve the wave equation u tt = u xx , 0 < x < 1, t > 0 with u(0, t) = u{ 1, t) = 0 and u(x, 0) = sin 
(n x), and u t (x, 0) = 0, 0 < x < 1, with Ax = 0.25, and At = 0.25 for three time steps. 

2. Solve y tt = y^, up to t = 0.5 with a spacing of 0.1, subject toy(0,£) = 0, y(l, f) = 0, 

y t (x,0) = 0, and y(x, 0) = 10 + x(l - x). (A. U. Nov / Dec. 2004) 

3. Approximate the solution of the wave equation u tt = u xx , 0<x<l,t>0 
u{0 , t) = it(l, t) = 0 and u(x, 0) = sin (2ji x), and u t (x, 0) = 0, 0 < x < 1, 
with Ax = 0.25, and At = 0.25 for three time steps. 

( A.U. Apr I May 2003, Nov I Dec. 2004) 

4. Solve u^ = u tt , 0 < x < 1, t > 0, given 

u(x, 0) = 100(x - x 2 ), U t {x, 0) = 0, u( 0, t) = u(l,t) = 0,t> 0, 
by finite difference method for one time step with h = 0.25. (A. U. Apr/May 2000) 

5. Solve u tt = u^ 0 <x < 1, t > 0, u{ 0, t) = w(l, t) = 0,t> 0, u{x, 0) =x - x 2 , u t {x, 0) = 0, taking 

h = 0.2 up to one half of the period of vibration by taking appropriate time step. 

(A.U. Nov I Dec. 1999) 

6. Solve u tt = u^, 0 < x < 1, t > 0, given 

u(x, 0) = u t (x, 0) = u( 0, t) = 0, and u( 1, t) = 100 sin (jit). 

Compute u for four time steps with h = 0.25. (A.U. Nov I Dec. 2003) 

7. Approximate the solution to the equation u a - u tt = 0, 0 < x < 1, t > 0, 

u( 0, t) = u( 1, t) = 0, t > 0, u(x, 0) = 1, 0 < x < (1/2), and u(x, 0) = - 1, (1/2) < x < 1, and 
u t (x, 0) = 0, 

using h = k = 0.1 for three time steps. (A. U. Nov / Dec. 2005) 

8. Solve u tt = u xx , subject to the following conditions 

u( 0, /) = it(l, t) = 0, t > 0, and u t (x, 0) = 0, u(x, 0) = sin 3 (jt x), 0 < x < 1, 
taking h = 1/4. Compute u for four time steps. (A. U. Apr I May 2006) 

9. Approximate the solution of the wave equation u tt = u xx , 0 < x < 1, £ > 0, 

ii(0, £) = u(l, £) = 0 and u(x, 0) = sin (2n x), and u t (x, 0) = 0, 0 < x < 1, 
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using the implicit method given in Eq.(5.72), with Ax = 0.25, and At = 0.25 for two time 
steps. 

10. Using the implicit method given in Eq.(5.74), solve u ft = u xx , 0 < x < 1, t > 0, given 

u(x, 0) = 100(x - x * 1 2 3 4 5 6 7 8 9 10 ), u t (x, 0) = 0, u( 0, t ) = u( 1, t) = 0, t > 0, with k = 0.25, h = 0.25. 
Compute for two time steps. 


5.7 ANSWERS AND HINTS 


Exercise 5.1 

In all problems, the resulting equations are solved by the Gauss elimination procedure. 

1. y x = 0.23159, y 2 = 0.46681, y 3 = 0.71661. 

2. Vl = 0.39707, y 2 = 0.94938, \ \ = 0.00146, | e 2 | = 0.00165. 

3. y x = 0.13319, y 2 = 0.28408, y 3 = 0.45503. 

4. y x = 1.45488, y 2 = 2.22502, | e 1 \ = 0.00301, | e 2 | = 0.00378. 

5. yi = 0.44811, y 2 = 0.84397, 3/3 = 1.08650. 

6. y x = - 0.04400, y 2 = - 0.04217. 

7. y x = 0.21767, y 2 = - 0.00218. 

8 . yi = 2.16811, y 2 = 2.10435, 3/3 = 1.54319. 

9. yi = 0.04400, y 2 = 0.04217. 

10. (i) 3/ 1 = - 0.00152, y 2 = 0.01220, 3 ^ = - 0.11128. (Oscillatory solutions). Errors in magni¬ 
tude: 0.00203, 0.00551, 0.19332. 

(ii)y 1 = 0.01677, y 2 = 0.07547, y 3 = 0.28092. Errors in magnitude: 0.01626, 0.06878, 
0.19888. 

(.iii)y 1 = 2.07692, y 2 = 0.69231, y 3 = 1.61538. Errors in magnitude: 2.07641, 0.68562, 
1.53334. 

Exercise 5.2 

1. Elliptic for all (x, y). 2. Hyperbolic for all (x, y). 

3. Elliptic for x 2 + y 2 < 0.25, parabolic for x 2 + y 2 = 0.25, hyperbolic for x 2 + y 2 > 0.25. 

4. Hyperbolic for all (x, 3 /). 

5. Elliptic for x 2 + 4y 2 > 4, parabolic for x 2 + 4y 2 = 4, hyperbolic for x 2 + 4y 2 < 4. 

Exercise 5.3 

In all the problems, we obtain the mesh as given in Fig.5.35. 

Using the standard five point formula, we obtain the system of equations as Au = b, where 
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and bj,i = 1, 2, 3, 4 are obtained from boundary conditions. In 
Problems 1 to 9, we have solved the systems by Gauss elimina¬ 
tion method. 



Fig. 5.35. Example 5.3. 


1. b = [4/3, 0, 0, - 4/3] T , u 1 = - 1/3, u 2 = 0 ,u 3 = 0, u A = 1/3. 

2. b = [1, - 7, - 3, - 11] T , u x = 1 ,u 2 = 3, u 3 = 2 ,u 4 = 4. 

3. b = [- 600, - 1000, - 200, - 600] T , u x = 300, u 2 = 400, u 3 = 200, u A = 300. (By symmetry 

we can start by setting u x = u 4 ). 

4. b = [- 3, - 12, 0, - 3] T , u x = 2,u 2 = 4, u 3 = 1, u 4 = 2. (By symmetry we can start by setting 

u i = u ^- 

5. b = [- 2, - 9, - 1, - 6] T , u x = 5/3, u 2 = 10/3, u 3 = 4/3, u A = 8/3. 

6. b = [4/3, 0, 0, - 4/3] T , u x = - 1/3, u 2 = 0, u 3 = 0, u A = 1/3. (By symmetry we can start by 
setting u 2 = u 3 ). 

7. b = [- 10/9, - 22/9, 2/9, - 10/9] T , u 1 = 5/9, u 2 = 8/9, u 3 = 2/9, u A = 5/9. 

8. b = [43/27, 10/27, 5/27, - 28/27] T , u x = - 101/216, u 2 = - 35/216, u 3 = - 25/216, u A = 41/ 
216. 

9. b = [5, 8, 2, 5] T , u x = - 5/2, u 2 = - 13/4, u 3 = - 7/4, u A = - 5/2. (By symmetry we can start 
by setting u x = u A ). 

10. We obtain the initial approximation u ^ 0) using the five point diagonal formula and u 4 = 0, 
whereas u 2 \ u 3 0) , u 4 0) are obtained by the standard five point formula, unless stated 
other wise. 

(i) 0, 1.75, 1.1875, 3.48438; 0.48438, 2.74219, 1.74219, 3.87110; 0.87110, 2.93555, 
1.93555, 3.96778; 0.96778, 2.98389, 1.98389, 3.99195; 0.99195, 2.99598, 1.99598, 
3.99799. 

(ii) 225.0, 306.25, 106.25, 253.125; 253.125, 376.5625, 176.5625, 288.28125; 288.28125, 
394.14063, 194.14063, 297.70315; 297.70315, 398.69337, 198.85158, 299.38624; 
299.38624, 399.69312, 199.69312, 299.84656. 

(iii) 1.5, 3.375,0.375,1.6875; 1.6875, 3.84375,0.84375,0.42188; 1.92188,3.58594,0.58594, 
0.29297; 1.79297, 3.52149, 0.52149, 0.26074; 1.76075, 3.50537, 0.50537, 0.25269. 

(iv) - 0.41667, - 0.10417, - 0.10417, 0.28125; - 0.45023, - 0.13484, - 0.08854, 0.20341; 

- 0.45399, - 0.15524, - 0.10894, 0.19321; - 0.46419, - 0.16034, - 0.11404, 0.19066; 

- 0.46674, - 0.16161, - 0.11532, 0.19003. 

C v ) Set all initial approximations as zeros. -1.25, - 2.3125, - 0.8125, - 2.03125; - 2.03125, 

- 3.01563, - 1.51563, - 2.38282; - 2.38282, - 3.19141, - 1.69141, - 2.47071; - 2.47071, 

- 3.23535, - 1.73537, - 2.49268. (If we use symmetry, that is, u x = u 4 , we get the 
fourth iteration as - 2.48047, - 3.24024, - 1.74024). 
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Exercise 5.4 

1. 0.09668,0.13672,0.09668. 2.0.12095,0.17053,0.12095. 

3. 0.125, 0.25, 0.125. 

4. (i) 0, 0, 0; (ii) 0.0625, 0, - 0.0625; (iii) 0.08779, 0, - 0.08779. 

5. The given data is discontinuous. The effect of the singularities at (0,0), (5, 0) is propagated 
into the interior when we use finite difference methods. Such problems require special 
techniques to deal with singularities. In the present problem, if we take the initial 
conditions valid at (0, 0) and (5, 0), that is, u 0 0 = 20, u 50 = 20, we obtain the solutions as 
15.0239, 20.0957, 25.3588, 41.3397. 

6. 0.7328, | e | = 0.0114. 7. 2.2345, 3.8069. 

8. 1/9, 0, - 1/9; 1/81, 0, - 1/81; | e 1 \ = \ e 3 | = 0.00695, | e 2 | = 0. 

9. 0.749665, 0.499943, 0.24999; 0.748856, 0.499723, 0.249941. 

10. 0.740683, 1.332299, 0.740683; 0.716668, 1.198160, 0.716668. 

Exercise 5.5 

1. 0.5, 0.70711, 0.5; 0, 0, 0; - 0.5, - 0.70711, - 0.5. 

2. Use explicit method. Assume h = 0.25. 10.1775, 10.24, 10.1775; 8.5491, 10.21, 8.5491; 
5.8186, 9.6485, 5.8186; 2.7699, 7.8614, 2.7699; 0.0927, 4.4450, 0.0927. 

3. Use explicit method. 0, 0, 0; - 1, 0, 1; 0, 0, 0. 

4. Use explicit method. Since k is not prescribed, choose k = h such that r = 1. 12.5, 18.75, 
12.5. 

5. Use explicit method. Period of vibration = [(2/ /c)] = 2. Computations are to be done up 
to / = 1. Since k is not prescribed, choose k = 0.2 such that r = (k/h) = 1. 

0.12, 0.20, 0.20, 0.12; 0.04, 0.08, 0.08, 0.04; - 0.04, - 0.08, - 0.08, - 0.04; - 0.12, - 0.20, 
- 0.20, - 0.12; - 0.16, - 0.24, - 0.24, - 0.16. 

6. Use explicit method. Since k is not prescribed, choose k such that r = (k/h) = 1. 

0, 0, 0; 0, 0, 50^2; 0, 50^2,100; 50^2,100, 50^2. 

7. The given data is discontinuous. The effect of the singularity at x = 1/2 is propagated 
into the interior when we use finite difference methods. Such problems require special 
techniques to deal with singularities. Use explicit method. Since k is not prescribed, 
choose k such that r = (k/h) = 1; 1, 1, 1, 1, 0, 0, - 1, - 1, - 1; 0, 1, 1, 0, 0, 0, 0, - 1, 0; 0, 0, 
0, 0, 0, 0, 0, 1, 0. 

8. Use explicit method. Since k is not prescribed, choose k such that r = (k/h) = 1. 

0.5, 1/(2V2), 0.5; 0, 0, 0; - 0.5, - 1/(2 Jl ), - 0.5; - 1/(2 Jl ), - 1, - 1/(2^). 

9. 0.5, 0, - 0.5; - 0.5, 0, 0.5. 

10. 15.17857, 20.53571, 15.17857; 5.86734, 8.67346, 5.86734. 



This page 
intentionally left 
blank 



Bibliography 


The following is a brief list of texts on numerical methods. There are various other texts which 
are not reported here. 

1. Atkinson, K., Elementary Numerical Analysis, Wiley, New York, 1985. 

2. Burden, R.L., and J.D. Faires, Numerical Analysis, 4th edition, PWS-Kent, 1989. 

3. Butcher, J.C., The Numerical Analysis of Ordinary Differential Equations: Runge-Kutta 
and General Linear Methods, Wiley, New York, 1987. 

4. Collatz. L., Numerical Treatment of Differential Equations, 3rd edition, Springer Verlag, 
Berlin, 1966. 

5. Conte, S.D., and C. deBoor, Elementary Numerical Analysis: An Algorithmic Approach, 
3rd edition, McGraw-Hill, New York, 1980. 

6 . Dahlquist, G., and A. Bjorck, Numerical Methods, Prentice Hall, Englewood Cliffs, N.J, 
1974. 

7. David Kincaid and W. Cheney, Numerical Analysis, Brooks/ Cole, Calif., 1991. 

8. Ferziger, J.H., Numerical Methods for Engineering Application, John Wiley, New York, 
1981. 

9. Fox, L., Numerical Solution of Ordinary and Partial Differential Equations, Pergamon, 
London, 1962. 

10. Froberg, C.E., Introduction to Numerical Analysis, Addison-Wesley, Reading, Mass., 
1969. 

11. Gear, C.W., Numerical Initial Value Problems in Ordinary Differential Equations, 
Prentice-Hall, Englewood Cliffs, N.J., 1971. 

12. Gerald, C.F., and P.O. Wheatley, Applied Numerical Analysis, 4th Ed., Addison-Wesley, 
Reading, Mass., 1989. 

13. Henrici, P., Elements of Numerical Analysis, John Wiley, New York, 1964. 

14. Householder, A.S., Principles of Numerical Analysis, McGraw-Hill, New York, 1953. 

15. Issacson, E., and H.B. Keller, Analysis of Numerical Methods, John Wiley, New York, 
1966. 

16. Jain, M.K., Numerical Solution of Differential Equations, 2nd ed., Wiley Eastern Ltd., 
New Delhi, 1984. 

17. Jain, M.K., S.R.K. Iyengar., and R.K. Jain, Numerical Methods for Scientific and 
Engineering Computation, Sixth Edition, New Age International Publishers, (Formerly 
Wiley Eastern Limited), New Delhi, 2008. 


311 




312 


NUMERICAL METHODS 


18. Johnson, L.W., and R.D. Riess., Numerical Analysis, 2nd ed., Addison-Wesley, Read¬ 
ing, Mass., 1982. 

19. Lambert, J.D., Computational Methods in Ordinary Differential Equations, John Wiley, 
New York, 1973. 

20. Lapidus, L., and J. Seinfeld, Numerical Solution of Ordinary Differential Equations, 
Academic Press, New York, 1971. 

21. Ralston, A., and P. Rabinowitz, A first course in Numerical Analysis, 2nd ed., McGraw- 
Hill, New York, 1978. 

22. Scheid, F., Numerical Analysis, McGraw-Hill, New York, 1988. 

23. Todd, J., Survey of Numerical Analysis, McGraw-Hill, New York, 1962. 



Index 


A 

abscissas, 128 

Adams-Bashforth methods, 217 

Adams-Bashforth predictor corrector methods, 227 

Adams-Moulton methods, 221 

algebraic equation, 1 

amplification factor, 238 

agumented matrix, 25 

B 

back substitution method, 27 
backward Euler method, 193 
Bender-Schmidt method, 277 
boundary conditions 
Dirichlet, 252 
first kind, 242 
mixed kind, 242 
second kind, 242 
third kind, 242 

C 

characteristic equation, 52 
chord method, 6, 11 
complete pivoting, 29 
condition of convergence, 16 
consistent system of equations, 26 
convergence of iteration methods, 19 
corrector methods, 221 
Cotes numbers, 129 


Crank-Nicolson method, 283 
cubic splines, 99 

D 

Descarte’s rule of signs, 4 
diagonal system of equations, 26 
diagonally dominant, 42, 47 
diagonal five point formula, 256, 257 
direct methods, 2, 26 
Dirichlet boundary value problem, 252 
discretization, 253 
divided differences, 70 
double integration, 169 


eigen value problem, 52 
eigen vector, 53 

elementary column transformation, 27 
elementary row transformation, 27 
error of approximation, 63 
error tolerance, 3, 41 
Euler method, 185 
Euler-Cauchy method, 194 
explicit methods, 183, 276, 291 
extrapolation, 186 

F 

finite differences, 80 

backward difference operator, 81 


313 










314 


NUMERICAL METHODS 


central difference operator, 83 
derivative operator, 87 
forward difference operator, 80 
mean operator, 85 
shift operator, 80 
finite difference method, 242, 252 
fixed point iteration method, 15 


L 

Lagrange fundamental polynomials, 65 
Lagrange interpolating polynomial, 65 
Laplace equation, 252 
Liebmann iteration, 263 
linear interpolation method, 6 


Gauss elimination method, 28 
Gauss-Jacobi iteration method, 41 
Gauss-Jordan method, 35 
Gauss-Seidel iteration method, 46 
general iteration method, 15 
grid points, 182 

H 

heat equation, 275 
Heun’s method, 194 


mesh points, 182 

mesh ratio parameter, 276, 292 

method of false position, 6 

method of simultaneous displacement, 42 

method of successive approximation, 15 

mid-point method, 193 

Milne’s predictor-corrector method, 227 

Milne-Simpson method, 225 

modified Euler method, 193 

multi step methods, 183, 216 

multiple root, 2 


implicit methods, 183, 275, 282, 301 

inconsistent system of equations, 26 

initial approximation, 3 

initial boundary value problem, 251, 275 

initial conditions, 180, 275 

initial point, 180 

initial value problem, 180 

intermediate value theorem, 4 

interpolating conditions, 63 

interpolating polynomial, 63 

inverse interpolation, 76 

iteration function, 3, 15 

iterative methods, 3, 26, 41, 263 

J 


natural spline, 100 
Newton-Cotes integration rules, 129 
Newton-Raphson method, 11 
Newton’s interpolating polynomial using 
backward differences, 92 
divided differences, 72 
forward differences, 90 
nodes, 63, 242, 253 
numerical differentiation using 

backward differences, 117 
divided differences, 122 
forward differences, 109 
numerical integration, 128 

composite Simpson’s 1/3 rule, 139 
composite Simpson’s 3/8 rule, 144 
composite trapezium rule, 131 


Jacobi method, 41 











INDEX 


315 


Gauss-Legendre methods, 160 
Romberg integration, 147 
Simpson’s 1/3 rule, 136 
Simpson’s 3/8 rule, 144 
trapezium rule, 129 

O 

operation count, 2, 26 
order, 19, 128, 183 


S 

Schmidt method, 276 

simple root, 2 

single step methods, 183 

spline, 99 

spline function, 99 

stability, 237 

standard five point formula, 253, 257 
step length, 242 


P 

partial differential equations, 
elliptic, 251 
hyperbolic, 251 
parabolic, 251 
partial pivoting, 29 
permanence property, 70 
Poisson equation, 252 
power method, 53 

predictor-corrector methods, 216, 225 


Q 

quadrature formula, 128 

R 

rate of convergence, 19 
regula-falsi method, 6 
root, 1 

Runge-Kutta methods, 200 

second order, 200 
fourth order, 202 


T 

tabular points, 63 

tangent method, 11 

Taylor series method, 184, 208 

transcendental equation, 1 

trapezium method 194, 223 

truncation error, 183, 255 

two point boundary value problem, 241 


U 

unconditionally stable methods, 237 
upper triangular system of equations, 27 


W 

wave equation, 291 
weight function, 128 











